-- Logs begin at Fri 2022-06-10 12:01:32 UTC, end at Fri 2022-06-10 13:18:01 UTC. -- Jun 10 12:43:40.507720 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 10 12:43:40.515762 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 10 12:43:40 2022] *** Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: nodename: dv-osbrick-master-4-iscsi Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: machine: x86_64 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: clock source: unix Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: pcre jit disabled Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: detected number of CPU cores: 4 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: current working directory: / Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: detected binary path: /usr/bin/uwsgi-core Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: your processes number limit is 47680 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: your memory page size is 4096 bytes Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: detected max file descriptor number: 2048 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: lock engine: pthread robust mutexes Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: thunder lock: enabled Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 10 12:43:40.520637 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 10 12:43:40.563732 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: Python main interpreter initialized at 0x56198bafd9c0 Jun 10 12:43:40.563732 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: python threads support enabled Jun 10 12:43:40.563732 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: your server socket listen backlog is limited to 100 connections Jun 10 12:43:40.563732 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: your mercy for graceful operations on workers is 90 seconds Jun 10 12:43:40.564107 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: mapped 403077 bytes (393 KB) for 2 cores Jun 10 12:43:40.564183 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: *** Operational MODE: preforking *** Jun 10 12:43:40.564422 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: *** uWSGI is running in multiple interpreter mode *** Jun 10 12:43:40.564422 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: spawned uWSGI master process (pid: 80166) Jun 10 12:43:40.564644 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 10 12:43:40.566885 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: spawned uWSGI worker 1 (pid: 80180, cores: 1) Jun 10 12:43:40.566885 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: spawned uWSGI worker 2 (pid: 80181, cores: 1) Jun 10 12:43:40.566885 dv-osbrick-master-4-iscsi devstack@keystone.service[80166]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 10 12:43:46.139525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 12:43:46.139525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes Jun 10 12:43:46.140329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 12:43:46.140329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes Jun 10 12:43:46.145195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 12:43:46.145195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jun 10 12:43:46.145654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 10 12:43:46.145654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Jun 10 12:43:46.188892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 12:43:46.189081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 12:43:46.189271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] command line args: [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 12:43:46.189536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 12:43:46.189713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ================================================================================ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 12:43:46.189963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.190205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] config_dir = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.190388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.190565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] config_source = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.190739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] debug = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.190932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.191297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.191486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.191723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.191969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.192195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.192373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_config_append = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.192549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.192754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_dir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.192944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.193125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 10 12:43:46.193234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.193298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 10 12:43:46.193486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.193619 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 10 12:43:46.193712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.193778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 10 12:43:46.193843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.193911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 10 12:43:46.194054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194167 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194287 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.194915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195370 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.195945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196252 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.10/identity {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.196937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] publish_errors = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197392 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.197931 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198217 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] standard_threads = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198378 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.198979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] use_journal = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] use_json = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199268 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] use_stderr = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] use_syslog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.199906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.199982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.200140 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.200299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.200439 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.200702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.200939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.10/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.201019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.201123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.201213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.201357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.201441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.201587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.201664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.201764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.201917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.201997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.202089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.202230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.202337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.202466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.202555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.202697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.202801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.202939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.203102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.203347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.203600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.203816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.203981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 10 12:43:46.204231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.204981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.205936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206619 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.206943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.207872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208111 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.208857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209460 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.209993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210141 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210248 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.210942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211063 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.211968 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.212918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213381 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213609 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.213919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214523 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214770 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.214999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.215771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.216508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.216700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.216781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.216900 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.217007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.217320 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.217560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.217797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.218937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.219900 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220063 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.220943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.221890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222832 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.222988 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.223913 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.224140 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.224374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.224603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.224862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.225839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.external = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.226821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.password = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.token = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.227947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.228986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.229930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.230882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.231010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.231111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.231202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.231284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.231358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.232842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.237823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.237914 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.238928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.239982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.240960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241153 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241650 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241790 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.241978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242524 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242825 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.242952 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243252 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243769 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.243969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244784 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.244911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245132 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245446 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.245917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.246852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.247929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248004 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248588 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.248920 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.249858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250323 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250697 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.250929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.251935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.252922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253378 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.253996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254230 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.254951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.255951 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256829 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.256902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.257839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.258934 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259408 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] role.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.259959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] role.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.260916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.261071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.265994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.266922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.267944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.268991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269622 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.269985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.270945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271577 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271734 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.271989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272524 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.272971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273101 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273228 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.273894 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.274920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.275949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.276871 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.277780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 12:43:46.278032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.278032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.278032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.278032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.279861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.280106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.280342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.280588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.280877 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.281128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.281365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.281610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.281840 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.282081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.282314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 10 12:43:46.282486 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 10 12:43:46.394682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.394856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.395042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.396112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.396343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.396565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.403449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.405847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.431902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.432129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.433727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.433956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.486812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.486977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.535033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.535261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.536368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.536601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.600867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601290 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601609 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.601933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.602015 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.602145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.602358 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.624998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625753 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.625887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626019 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626153 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.626814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.637180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.637437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.650265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.650470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.650665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.650886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.651915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.652126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.652339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 10 12:43:46.669341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.669546 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 10 12:43:46.669880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.670333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 10 12:43:46.670773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.671039 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.671297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.671550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.672965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.673173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 10 12:43:46.673501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.673698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 10 12:43:46.674142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.674399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.674652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.674901 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.682371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.682643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.682907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.683184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.685891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.686164 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.686425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.686697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.691402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.694785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.695057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.695332 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.695607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.695803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.695886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.696123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.696384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.696672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.696940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.697208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.697466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.699229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.699508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.699784 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.700060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.701155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.701418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.701685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.701949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.702219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.702481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.725145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.726743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.727017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.729740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.731357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.731692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.732395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.732693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.732970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.737188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.737336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.737562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.740308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.740583 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.745003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.745093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.745282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.745367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.745590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.745865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.746135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.746404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.746666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.746928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.750507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.750790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.751068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.751347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.751620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.751891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.752155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.752417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.766604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.766873 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.771356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.771888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.772162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.774975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.775262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.776767 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.780321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.780477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.780794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.783885 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.785955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.787578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.787867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.788154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.788445 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.788752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.789028 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.789599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.793324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.793628 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.793946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.794241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.794688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.794966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.808275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.808554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.808838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.809094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.815067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.815349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.815612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.815868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.817572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.819277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.819554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.822634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.822907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.823805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.824473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.824789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.825072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.826152 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.826414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.829516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.829790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.831396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.831695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.831981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.838758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.839030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.839301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.839573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.839853 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.840122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.840394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.845351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.845623 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.845908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.846183 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.846459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.846727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.846995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.858508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.861797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.865084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.865268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.866684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.868449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.868532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.868751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.869033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.871830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.874084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.875886 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.876160 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.876439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.877152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.878754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.881981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.882270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.882544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.882812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.883742 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.885385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.889461 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.889746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.890025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.890300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.892881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.893160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.893431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.899783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.900077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.900397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.901226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.901499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.901783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.902071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.902334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.902616 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.902881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.903147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.903452 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.903903 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.904174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.904453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.904741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.904999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.908404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 10 12:43:46.908708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.909000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.909283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.909551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.909829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.910111 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.910386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.910653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.911024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.911294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.911569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.911832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.912092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 10 12:43:46.943211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198bafd9c0 pid: 80180 (default app) Jun 10 12:43:46.946586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e26e4-6f00-46e3-8416-11120042e47e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:46.946884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e26e4-6f00-46e3-8416-11120042e47e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:46.947160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e26e4-6f00-46e3-8416-11120042e47e None None] PATH_INFO: `/v3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:46.951982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1/1] 10.222.0.10 () {50 vars in 791 bytes} [Fri Jun 10 12:43:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:43:46.952608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56198bafd9c0 pid: 80181 (default app) Jun 10 12:43:55.842798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:55.843340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:55.843340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:55.844716 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 2/2] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:43:55.852255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:55.852700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:55.852841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:55.921669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: INFO dbcounter [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] Registered counter for database keystone Jun 10 12:43:55.942946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 12:43:55.948985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 12:43:56.133583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 10 12:43:56.134006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 10 12:43:56.188829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:43:56.190377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:43:56.311822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/3] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:43:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 10 12:43:56.444321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:43:56.513665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: INFO dbcounter [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] Registered counter for database keystone Jun 10 12:43:56.533101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG oslo_db.sqlalchemy.engines [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 10 12:43:56.539278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writer thread running {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 10 12:43:56.659763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba1c2b-c1fd-4810-9e21-26d9d43fa3a8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:43:56.664034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:43:56.664732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:56.665017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:56.665293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:56.674317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:43:56.726255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 10 12:43:56.726536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd979f-9865-4d3d-a754-24411630c2e5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:43:56.736948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 3/4] 10.222.0.10 () {58 vars in 1324 bytes} [Fri Jun 10 12:43:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 12:43:56.742881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:43:56.759725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3d531-3e46-4fc0-907f-3c83369da363 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:43:56.764311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:43:56.765479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:56.765771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:56.766052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] PATH_INFO: `/v3/projects/cacd4613b1334c5abdaa9f563eb09cde` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:56.767536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] RBAC: Authorizing `identity:get_project(project_id=cacd4613b1334c5abdaa9f563eb09cde)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:43:56.821383 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 10 12:43:56.821725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c3d5a-c07a-44d6-83ee-db8ae4ad8cc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:43:56.826748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/5] 10.222.0.10 () {56 vars in 1207 bytes} [Fri Jun 10 12:43:56 2022] GET /identity/v3/projects/cacd4613b1334c5abdaa9f563eb09cde => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:43:58.911327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797370-a9c1-41b3-97c9-7c483c14986d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:58.911827 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797370-a9c1-41b3-97c9-7c483c14986d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:58.911827 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797370-a9c1-41b3-97c9-7c483c14986d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:58.915886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 4/6] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:43:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:43:58.921623 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:58.922042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:58.922181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:58.941022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:43:58.942545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:43:58.950970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/7] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:43:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 10 12:43:58.972720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797370-a9c1-41b3-97c9-7c483c14986d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:43:58.984459 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797370-a9c1-41b3-97c9-7c483c14986d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:43:58.988612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:43:58.989255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:58.989538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:58.989812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:58.998248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:43:59.000000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f5c2c-8fe4-4f02-9dc0-5797f0a039c9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:43:59.008528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 5/8] 10.222.0.10 () {58 vars in 1324 bytes} [Fri Jun 10 12:43:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 12:43:59.014462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:43:59.023256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7e09f-aa77-44b6-a280-a2835e38fd56 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:43:59.027583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:43:59.028441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:43:59.028832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:43:59.029121 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:43:59.030502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:43:59.032305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a94d6-9d23-4f5f-9090-29efc94a056f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:43:59.033894 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/9] 10.222.0.10 () {56 vars in 1198 bytes} [Fri Jun 10 12:43:59 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:01.193596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8fa4-923c-4c2e-9f22-00c6014bed31 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.194110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8fa4-923c-4c2e-9f22-00c6014bed31 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.194212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d8fa4-923c-4c2e-9f22-00c6014bed31 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.195659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 6/10] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:01.201358 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.201786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.201984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.218308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:01.219494 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:01.220334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efb9d-a5e7-4324-98c9-d11cbafa8526 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.220641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efb9d-a5e7-4324-98c9-d11cbafa8526 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.220941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613efb9d-a5e7-4324-98c9-d11cbafa8526 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.222273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 7/11] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:01.227121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.227411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.227692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.267757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 10 12:44:01.268174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 10 12:44:01.302343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/12] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:01.315114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:01.316739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:01.325691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.349018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:01.415977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 8/13] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:01.428505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58467288-cb39-46e9-924d-8bf6a6d2c53b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.440017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.462674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.463400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.463690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.463968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.475481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:01.486582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:01.487509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:01.488327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/14] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:01.493647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.539210 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0883-24c6-4c5e-b80b-4af7054235e5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.541964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:01.578273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:01.579724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.580637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.580932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.581211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.595958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844c96a-0b3b-4104-a569-a2bbf15468f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.631017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.631683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.631965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.632246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.633032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:01.633341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:01.634740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:01.647415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/15] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:01.650895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:01.652441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:01.652800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.749540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 9/16] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 10 12:44:01.751862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afd98d-b0b8-4a09-97bc-c371d0fbd764 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.755045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.757758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:01.787562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.788437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.788755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.789036 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.790278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:01.791725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:01.793443 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/17] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:01.799046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.813824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:01.855017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577d692-b449-482f-8e1c-f334d60cc396 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.890195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.890981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.891259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.891530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.896441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4841303-c1cb-4e0e-8f4f-0c63aebbe94d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:01.909223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:01.910689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:01.929748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:01.930539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:01.930821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:01.931102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:44:01.931297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:01.932232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:01.933279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:44:01.933279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:44:01.933279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:44:01.933279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:01.933279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 10/18] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:01.935168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:01.936600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:01.942661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/19] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:01.942805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.943936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:01.993692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:02.022660 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:02.037817 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e34f8-2a35-451e-a620-4c22bd59cb31 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:02.042410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2b53c-c2c5-41bc-8099-d87e946ae895 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:02.071397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:02.072058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:02.072342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:02.072635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:02.073373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:02.073683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:02.075322 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fe427-1e1e-4c2e-980e-60d041cdc7c1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:02.077238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:02.077888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:02.078172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:02.078450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:02.079287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.domain.id=default, user.id=b7bb6edd4f154eb88b778d90110b667e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:02.079655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:02.081135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f3f68-6ce0-4c12-a446-bdb1f5042535 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:02.087761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/20] 10.222.0.10 () {56 vars in 1322 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/role_assignments?user.id=b7bb6edd4f154eb88b778d90110b667e&scope.domain.id=default&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:02.093045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 11/21] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:04.547564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1dc6-ed7d-4508-97dc-134d5d8aef8a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:04.548637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1dc6-ed7d-4508-97dc-134d5d8aef8a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:04.549120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f1dc6-ed7d-4508-97dc-134d5d8aef8a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:04.550702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/22] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:04.556512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0f928-b5ac-444f-8efb-7169371bbe71 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:04.557366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0f928-b5ac-444f-8efb-7169371bbe71 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:04.557851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0f928-b5ac-444f-8efb-7169371bbe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:04.576231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-52c0f928-b5ac-444f-8efb-7169371bbe71 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:04.577802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52c0f928-b5ac-444f-8efb-7169371bbe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:04.648404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 12/23] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:04.690980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1dc6-ed7d-4508-97dc-134d5d8aef8a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:04.842767 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f1dc6-ed7d-4508-97dc-134d5d8aef8a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:04.865250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e6d13-beb8-410b-8616-158692856201 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:04.865852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e6d13-beb8-410b-8616-158692856201 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:04.866326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e6d13-beb8-410b-8616-158692856201 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:04.868336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 13/24] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:04.874801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:04.875571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:04.876061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:04.892116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:04.892950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:04.893233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:04.893510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:04.913644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:04.913922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:04.915313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:04.927842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:04.928721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:04.929480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/25] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:04.936483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:04.949506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:04.998462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.038450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 14/26] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:05.081400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.113117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3afefb-22e4-4708-bf46-a1229c4cc687 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.214115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.214817 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.215127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.215346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.216221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:05.216569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.217949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01312b-aecc-406a-84c3-1a82635fe169 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:05.230186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea7f74-ac03-49dd-86b4-b35b0de0dbae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.242850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/27] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:05.244208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc085a-d105-4158-b55e-e467606005d8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.244496 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc085a-d105-4158-b55e-e467606005d8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.244796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc085a-d105-4158-b55e-e467606005d8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.246559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/28] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:05.251736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc085a-d105-4158-b55e-e467606005d8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.277391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.278109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.278391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.279677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.279677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.281597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c41d45-3125-4001-a1f2-d2186f3400ac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:05.342078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.379176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc085a-d105-4158-b55e-e467606005d8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.416500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.417545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.417824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.418097 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.420365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.421926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e8750-45f0-4d5c-a12f-a0cd98b105f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:05.423676 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/29] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:05 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:05.425025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74b5d-b4df-4345-9f14-9dc758a5bacc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.425308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74b5d-b4df-4345-9f14-9dc758a5bacc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.425583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac74b5d-b4df-4345-9f14-9dc758a5bacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.446745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2ac74b5d-b4df-4345-9f14-9dc758a5bacc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:05.447913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2ac74b5d-b4df-4345-9f14-9dc758a5bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:05.518932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/30] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:05.525879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e65b-947c-40f5-8505-cec143c6bd30 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.526172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e65b-947c-40f5-8505-cec143c6bd30 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.526495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542e65b-947c-40f5-8505-cec143c6bd30 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.527937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/32] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:05.528496 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542e65b-947c-40f5-8505-cec143c6bd30 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.532839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 15/32] 10.222.0.10 () {60 vars in 1131 bytes} [Fri Jun 10 12:44:05 2022] POST /identity/v3/roles => generated 219 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:05.554062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.554370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.554625 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.587852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:05.589545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:05.628979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.680886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 16/33] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:05.681942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.685630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.754038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542e65b-947c-40f5-8505-cec143c6bd30 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.801328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.802577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.803220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.803697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.805309 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.807206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:05.809952 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/34] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:05.811045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.835404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535c8c6-9c20-4e02-a365-60f11da240ec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.875865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.876998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.877458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.877981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.894389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.896022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:44:05.916794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:05.917642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 17/35] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:05.918933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:05.940571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.945839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbf4d3-895f-4131-b477-467e6ddb6e53 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:05.978945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:05.984572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:05.985281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:05.985621 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:05.985899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:05.986643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:05.988021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89fe6d-171a-45aa-8e45-fc3c9789bd6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.027493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f92cc-88cd-400c-8850-c96aaef5036d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:06.061884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:06.062750 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.063035 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.063316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] PATH_INFO: `/v3/domains/default/users/b7bb6edd4f154eb88b778d90110b667e/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.065695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b7bb6edd4f154eb88b778d90110b667e, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:06.067150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c34f5-d355-4bbc-9e38-b89b141ac5ce None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.174055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 18/36] 10.222.0.10 () {58 vars in 1361 bytes} [Fri Jun 10 12:44:05 2022] PUT /identity/v3/domains/default/users/b7bb6edd4f154eb88b778d90110b667e/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:06.174055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e790fe2-f082-4fc2-831a-184b7fe54225 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.174055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e790fe2-f082-4fc2-831a-184b7fe54225 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.174055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e790fe2-f082-4fc2-831a-184b7fe54225 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.174055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 19/37] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:06.179085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e790fe2-f082-4fc2-831a-184b7fe54225 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:06.283165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:06.288352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/38] 10.222.0.10 () {60 vars in 1131 bytes} [Fri Jun 10 12:44:05 2022] POST /identity/v3/roles => generated 225 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:06.289777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f0f4-bc00-499d-9f56-d50a100d3d18 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.290014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f0f4-bc00-499d-9f56-d50a100d3d18 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.290293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858f0f4-bc00-499d-9f56-d50a100d3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.310901 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2858f0f4-bc00-499d-9f56-d50a100d3d18 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:06.312425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2858f0f4-bc00-499d-9f56-d50a100d3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:06.328634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e790fe2-f082-4fc2-831a-184b7fe54225 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:06.375485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:06.376237 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.376526 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.376926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.377683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:06.377996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:06.379521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.414096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/39] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:06.415532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a9796-469f-48d6-8de9-1d05c0f61b6c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.415827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a9796-469f-48d6-8de9-1d05c0f61b6c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.416106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a9796-469f-48d6-8de9-1d05c0f61b6c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.417823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/40] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:06.424521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.424894 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.425175 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.444856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:06.446371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:06.516283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 20/41] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:06.518401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:06.550542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/42] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:06.551302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:06.607737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:06.654456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4f81b-5fe4-4488-bda5-a1d266efe3b9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:06.667007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa455c-3ec1-4daa-967f-d0233249fcc7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:06.692742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:06.694289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.694581 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.694864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.695615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:06.697068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.705957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:06.706670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.709058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.709058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.709058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:06.709574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.756819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:06.762774 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 21/43] 10.222.0.10 () {60 vars in 1131 bytes} [Fri Jun 10 12:44:06 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:06.763630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:06.796276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/44] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:44:06 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:06.899597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f2fd9-5459-4866-8eea-f10ea3418627 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:06.942528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:06.943348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:06.943637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:06.943920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:06.945528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:06.947288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735c08a-8349-4557-badf-c6cb7b292a51 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:06.948858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 22/45] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:06.955249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:07.065236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9fa34-7b43-45a3-af4b-092eaaf1dce1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:07.067592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:07.099372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:07.100039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:07.100329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:07.100609 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:07.101408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:07.103156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64fcd2-9b3c-4ce2-8292-8745789cedc2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:07.217904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/46] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:44:06 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:44:08.418274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cca44-184b-4585-8a14-f43c66f4e152 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:08.455895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cca44-184b-4585-8a14-f43c66f4e152 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:08.455895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cca44-184b-4585-8a14-f43c66f4e152 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:08.455895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 23/47] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:08.456180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:08.456180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:08.456180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:08.456180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:08.456180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:08.511247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/48] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:08.534500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cca44-184b-4585-8a14-f43c66f4e152 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:08.600690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:08.638109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cca44-184b-4585-8a14-f43c66f4e152 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:08.670896 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:08.671661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:08.671953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:08.672231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:08.683248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:08.692066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:08.693121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:08.693936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 24/49] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:08.699079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:08.781061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:08.796026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b7bdb-70ca-4102-86bd-de6108f47257 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:08.828244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:08.828936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:08.829222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:08.829536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:08.830288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:08.830800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:08.832470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:08.841513 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/50] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:08.847230 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:08.948200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f198ea-1a22-4be1-bbb9-1a35315af197 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:08.974598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:08.983756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:08.984655 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:08.984943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:08.985221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:08.986418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:08.987871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:08.989538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 25/51] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:08 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:09.001384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:09.096403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92145a-95f7-4147-b17c-67c7c0bcbb67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:09.129880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:09.130667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.130955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.131236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.132440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:09.133958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648e7a4-f6a2-447e-909b-b415d73c9b1a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:09.135576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/52] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:09.141740 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:09.241823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade08b-d816-4e66-9ac4-f2341b9d471d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:09.274209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:09.276223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.276223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.276223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.276522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.domain.id=default, user.id=b7bb6edd4f154eb88b778d90110b667e) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:09.276738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:09.279026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87217a8-c40b-428e-9fc3-8d290fdea804 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:09.288272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 26/53] 10.222.0.10 () {56 vars in 1322 bytes} [Fri Jun 10 12:44:09 2022] GET /identity/v3/role_assignments?user.id=b7bb6edd4f154eb88b778d90110b667e&scope.domain.id=default&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:09.341356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c708-a143-4fea-96f4-4518415358b9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.341652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c708-a143-4fea-96f4-4518415358b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.341935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617c708-a143-4fea-96f4-4518415358b9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.343384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/54] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:09.349307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.349602 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.349887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.367875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:09.369160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:09.427857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:09.441566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 27/55] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:09.465312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c708-a143-4fea-96f4-4518415358b9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:09.485484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:09.568913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617c708-a143-4fea-96f4-4518415358b9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:09.600806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:09.601592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.601879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.602155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.603319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:09.604779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753c9e-ee25-4edc-a28c-9cf7fc0c1dda None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:09.607152 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/56] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:09.612562 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:09.707610 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1627518-78be-46e9-bb55-30551a98d261 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:09.740053 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:09.740730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:09.741020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:09.741300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:09.742015 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:09.743483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233c8ed-ff87-4591-a573-2f34cc7d9081 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:09.865483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 28/57] 10.222.0.10 () {60 vars in 1140 bytes} [Fri Jun 10 12:44:09 2022] POST /identity/v3/projects => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:11.956258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf48f-6c7c-47c5-b29b-7730fcd972be None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:11.956791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf48f-6c7c-47c5-b29b-7730fcd972be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:11.956791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48abf48f-6c7c-47c5-b29b-7730fcd972be None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:11.958168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/58] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:11.963111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:11.963522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:11.963674 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:11.980760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:11.982615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:12.015058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:12.046640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 29/59] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:12.071056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf48f-6c7c-47c5-b29b-7730fcd972be None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:12.153512 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:12.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48abf48f-6c7c-47c5-b29b-7730fcd972be None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:12.206775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:12.207481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:12.207765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:12.208041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:12.209226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:12.210668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28550cc3-e878-45cd-81c2-af5d3db7e106 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:12.212274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/60] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:12.218341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:12.315921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf01eb-579b-4c98-871e-d75d699c2f17 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:12.350433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:12.351090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:12.351373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:12.351649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:12.352374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:12.353867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b8bc-92fb-42bd-ad3f-2f71539e9dbe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:12.465236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 30/61] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:12 2022] POST /identity/v3/users => generated 275 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:44:15.522550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa76a-f640-4411-83bc-189feff012b8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:15.523097 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa76a-f640-4411-83bc-189feff012b8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:15.523174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa76a-f640-4411-83bc-189feff012b8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:15.524874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/62] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:15.529910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:15.530322 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:15.530512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:15.553718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:15.560574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:15.581627 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:15.647511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 31/63] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:15.682955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aa76a-f640-4411-83bc-189feff012b8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:15.818014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aa76a-f640-4411-83bc-189feff012b8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:15.869847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:15.871070 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:15.872223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:15.872887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:15.893804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2d1d2220-5602-482e-9ae3-6844cb302643 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:15.902112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:15.903517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:15.904341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:15.906949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/64] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:15.917750 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:15.994805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf993-ed2a-4d9f-bef9-28ccd02fbaeb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:15.995459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf993-ed2a-4d9f-bef9-28ccd02fbaeb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:15.995956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbf993-ed2a-4d9f-bef9-28ccd02fbaeb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:15.997888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/65] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:16.003875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc667de-b3d7-41b3-b21b-7695a728c4f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.004168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc667de-b3d7-41b3-b21b-7695a728c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.005045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc667de-b3d7-41b3-b21b-7695a728c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.033267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-afc667de-b3d7-41b3-b21b-7695a728c4f0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:16.034602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-afc667de-b3d7-41b3-b21b-7695a728c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:16.045947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3619de-c564-4687-a062-fdfb74498e8d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.049703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.086861 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.087457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.087748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.088031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.088827 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:16.089142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:16.090760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f8376-26ff-47f4-9593-aabd154e86ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:16.107490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 32/66] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:16.108875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5620f-6dfd-4516-8925-7337949cc067 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.109174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5620f-6dfd-4516-8925-7337949cc067 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.109461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5620f-6dfd-4516-8925-7337949cc067 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.115407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 33/67] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:16.120103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5620f-6dfd-4516-8925-7337949cc067 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.147556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/68] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:16.148977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.149279 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.149713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.150144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.172295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:16.173848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:16.244278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5620f-6dfd-4516-8925-7337949cc067 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.262588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/69] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:16.263755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.291215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.292507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.293039 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.294106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.312220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:16.314135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3501bb-c70e-4682-8626-992cf175d5aa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:16.316173 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 34/70] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:16.317809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfc0f-1cb4-4d74-b88b-13379dab090a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.318278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfc0f-1cb4-4d74-b88b-13379dab090a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.318475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfc0f-1cb4-4d74-b88b-13379dab090a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.319814 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 35/71] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:16.324768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfc0f-1cb4-4d74-b88b-13379dab090a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.342245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.373855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c8a9b-50c3-4c86-9d06-182710dadee6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.406649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.411835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.412760 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.413022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.413350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.424701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:16.430740 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfc0f-1cb4-4d74-b88b-13379dab090a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:16.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:16.436217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:16.437033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:16.439736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/72] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:16.440474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.468103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.468919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.469208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.469487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.480065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-709b876e-69b7-4a32-9219-518be67ef911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:16.489521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:16.490400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:16.491138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 36/73] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:16.492457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.492457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.492457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.509630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:16.511297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:16.558104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe469d-d11c-4a8c-b8c4-ac7ac1053aa2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.596725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 37/74] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:16.596725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.597716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.601215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.601870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.602154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.602429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.665061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.679196 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:16.681257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edecf42e-6039-4c4e-bfaf-7c5b32a810dd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:16.706539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8fcc48-5c98-4b55-8f75-48aceac4767d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.753070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.753727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.754012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.754288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.755040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:16.755345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:16.756764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:16.767744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 38/75] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:16.768598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.803909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/76] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:16.805516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b978-c4cc-4905-abee-8b553d0ef363 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.805812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b978-c4cc-4905-abee-8b553d0ef363 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.806093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389b978-c4cc-4905-abee-8b553d0ef363 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.807369 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/77] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:16.808064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b978-c4cc-4905-abee-8b553d0ef363 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.843286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.880880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0eb5c8-df3a-4325-afd5-f66b621fa0ff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.911278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:16.921192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.921641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5389b978-c4cc-4905-abee-8b553d0ef363 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:16.921864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.922149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.922428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.923181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:16.923490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:16.925189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:16.935462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 39/78] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:16.936669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:16.965482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:16.966368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:16.966659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:16.966938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:16.977356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:16.985688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:16.986523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:16.987293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/79] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:16.987932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.042998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1809c9-fb0f-4bdb-bc77-b1df2eb0b104 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.078021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.078887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.079295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.079408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.079494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.080798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.082256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b2f80-a9ac-41b0-9ab3-d903993be5c4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.083869 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 40/80] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.085040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.085375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.085658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.088221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38102df-db70-489d-9316-6943b7d49069 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.101454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:17.102682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:17.123832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.124743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.125035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.125312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.126509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.127974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.129715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/81] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:16 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.130485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.156908 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.170933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 41/82] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:17.171751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.245599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296d281-dfb3-4ef1-827c-cbaa43b1a1e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.269482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af096b4b-9bf3-4c85-964e-16aa2dc6bb5f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.278376 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.279384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.279670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.279954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.281180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.282648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.284275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/83] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.285071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.303702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.304366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.304688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.304977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.305720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:17.306030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.307404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.313736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.315626 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 42/84] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.320056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.368444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.385617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1be08-6e64-47af-967e-bb7c5d9a2b02 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.416793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14611d81-7475-4cf5-9de8-cd842765c943 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.419679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.420589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.420905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.421187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.449586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.450377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.450670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.450954 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.451789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:17.452106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.453623 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.458918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 43/85] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.459701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.492021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.494088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.530419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.592207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc2ef-dae9-4d33-a669-4fc32b3226fe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.609813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.616650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/86] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:17.616650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.633410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b212c-0677-46fd-89e5-742db385151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.634329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b212c-0677-46fd-89e5-742db385151e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.634615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b212c-0677-46fd-89e5-742db385151e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.634950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b212c-0677-46fd-89e5-742db385151e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.636902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b212c-0677-46fd-89e5-742db385151e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.638868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b212c-0677-46fd-89e5-742db385151e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.640712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 44/87] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.645240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b212c-0677-46fd-89e5-742db385151e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.726713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d1c17-7aba-4adf-9996-168632acf56f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.754082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b212c-0677-46fd-89e5-742db385151e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.754935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.762800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.768874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.768874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.768874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.791265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.792143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.792428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.792811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.794824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.796527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.802407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 45/88] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.802407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.841555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.843041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.852329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:17.906327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0a9c0-3955-457e-b2a0-c4d657801106 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:17.943428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:17.944289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:17.944575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:17.944885 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:17.946068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:17.947529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:17.949246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 46/89] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:17.950772 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.953876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/90] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:17.954730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:17.984111 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.059605 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d376a-d160-486b-8856-3c3790d5f9a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.063606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c47c0-7d9b-4b4c-a3c9-6180c18666ee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.081766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.096409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.097099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.097454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.097696 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.097945 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.098610 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.098897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.099176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.099899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.101387 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.165601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.167084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.196991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 47/91] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:17 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:18.196991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:18.209886 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.314715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/92] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:18.316076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:18.321539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769d575-cfee-42e3-8b49-991f8b9a48ed None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.368671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.369818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.370185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.370541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.372609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.374209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.376440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 48/93] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:18 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:18.377486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:18.436427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.451010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f366c8f-5a72-4bb4-8ec0-9b45053f5f38 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.486253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.500110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.501385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.501385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.503054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.503934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:18.504358 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.506869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.514010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b3fde-f0d9-4b33-98fd-8618b72da14b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.516745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/94] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:18 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=e253d3f882df44caa26394cdc954b92a => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:18.516745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:18.565528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.566361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.566650 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.566932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] PATH_INFO: `/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.569404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] RBAC: Authorizing `identity:get_project(project_id=fa5ea86c5bc8495c9f06ccd73b350ef0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.570921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.572858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 49/95] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:18 2022] GET /identity/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:18.579703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:18.677058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233bd6e-2b49-445e-892d-4169655c8125 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.723789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.724765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.725061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.725349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.726211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=b7bb6edd4f154eb88b778d90110b667e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:18.726530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.726713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f46ee7-9228-424d-b271-4215849b2ceb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:18.728023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46448cf7-3c8d-4dc3-95b2-d6403a609c8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.738606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/96] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:18 2022] GET /identity/v3/role_assignments?user.id=b7bb6edd4f154eb88b778d90110b667e&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:18.746264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:18.770721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:18.770721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:18.770721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:18.771253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:18.773206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=fa5ea86c5bc8495c9f06ccd73b350ef0, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:18.773206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:18.773649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d2e7e-bd4d-489f-83fd-1aa193e933e8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:18.781157 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 50/97] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:18 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=fa5ea86c5bc8495c9f06ccd73b350ef0&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:20.007233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58402-ab7b-4297-b734-75c00c30a26f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.008234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58402-ab7b-4297-b734-75c00c30a26f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.008752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58402-ab7b-4297-b734-75c00c30a26f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.010332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/98] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:20.015722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.016653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.017150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.034158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:20.035617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:20.105204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 51/99] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:20.128198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58402-ab7b-4297-b734-75c00c30a26f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:20.199951 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:20.256472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58402-ab7b-4297-b734-75c00c30a26f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:20.304764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:20.305942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.306441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.306916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.325112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:20.333103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:20.334005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:20.334763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:20.337114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/100] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:20.343594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:20.487361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957abd-0b8e-4fb1-82d8-9d4cb8e8c524 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:20.493630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:20.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35238471-6c73-4260-a330-42b490794469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:20.532943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35238471-6c73-4260-a330-42b490794469 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.533234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35238471-6c73-4260-a330-42b490794469 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.533518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35238471-6c73-4260-a330-42b490794469 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.534276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35238471-6c73-4260-a330-42b490794469 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:20.534590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35238471-6c73-4260-a330-42b490794469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:20.535987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35238471-6c73-4260-a330-42b490794469 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:20.549432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 52/101] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:20.555050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:20.694149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8295b-9e20-4519-96a2-0e5e93b45b15 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:20.719947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:20.740418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:20.741316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.741598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.741872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.745333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:20.746956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:20.748745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/102] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:20 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:20.754400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35238471-6c73-4260-a330-42b490794469 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:20.909862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35238471-6c73-4260-a330-42b490794469 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:20.955511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:20.956856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:20.957362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:20.957851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:20.959435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:20.961220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0760e587-ab98-42cf-95fc-ba335ebfc8d9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:20.964347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 53/103] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:20 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:20.971096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:21.055921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc0f4-a2b9-4684-a776-b961c003ddf3 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.056920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc0f4-a2b9-4684-a776-b961c003ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.057420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc0f4-a2b9-4684-a776-b961c003ddf3 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.059668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 54/104] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:21.069924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.070515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.071055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.097889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:21.101086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:21.146293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:21.151324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28442a17-e1a4-41a9-9083-f056f24ed070 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:21.221950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:21.223439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.225159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.226035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/users/8faceef41f5540618c0b0bd5ebe3f908/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.230421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, user_id=8faceef41f5540618c0b0bd5ebe3f908, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:21.230824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 55/105] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 10 12:44:21.232509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:21.263280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:21.340585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/106] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:20 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/users/8faceef41f5540618c0b0bd5ebe3f908/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:21.382487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5a44a-12a8-4c07-8eee-0fc03bbc10e5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:21.421032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:21.422231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.422738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.423227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.435489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:21.443891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:21.444819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:21.445598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:21.448117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 56/107] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:21.454854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:21.515968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:21.594645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571bc22-7c40-4b17-889a-5c72614307b9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:21.661601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:21.662670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.663162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.663650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.664663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:21.665195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:21.666771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74707b47-954a-4789-9c04-9fb68462fcef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:21.680285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/108] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:21.686461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:21.729127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:21.828094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbfb8-1a83-47d8-b989-cc31b0f1d44e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:21.865637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:21.866695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.867209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.867735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] PATH_INFO: `/v3/users/9b0e6dd00152428094dc6edbd4c261c5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.886109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0e6dd00152428094dc6edbd4c261c5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:21.887895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:21.890012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 57/109] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:21 2022] GET /identity/v3/users/9b0e6dd00152428094dc6edbd4c261c5 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:21.893124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0960-ddbc-4d98-af6a-5cb491c873af None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.893479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0960-ddbc-4d98-af6a-5cb491c873af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.893765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b0960-ddbc-4d98-af6a-5cb491c873af None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.895277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/110] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:21.899018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:21.907339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca118-8fb9-4cb1-8a50-7eb5639d2404 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:21.907631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca118-8fb9-4cb1-8a50-7eb5639d2404 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:21.907919 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdca118-8fb9-4cb1-8a50-7eb5639d2404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:21.936887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bfdca118-8fb9-4cb1-8a50-7eb5639d2404 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:21.938120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfdca118-8fb9-4cb1-8a50-7eb5639d2404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:22.093081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.096312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/111] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:22.097707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005731-4a79-49e5-ae5f-e9c4a5cd3f94 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.098030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005731-4a79-49e5-ae5f-e9c4a5cd3f94 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.104194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005731-4a79-49e5-ae5f-e9c4a5cd3f94 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.104194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/112] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:22.107987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139830d-a045-416e-b19f-0f4f7dd2f87c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.108405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139830d-a045-416e-b19f-0f4f7dd2f87c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.108720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139830d-a045-416e-b19f-0f4f7dd2f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.125265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613b2e3-7775-4c8f-9098-44f7612ebf13 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.133559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a139830d-a045-416e-b19f-0f4f7dd2f87c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:22.134930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a139830d-a045-416e-b19f-0f4f7dd2f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:22.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.167072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.168091 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.169321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.170172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.205189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/113] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:22.206537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f092e5-86b7-48c5-8a58-9d7505ff5522 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.206828 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f092e5-86b7-48c5-8a58-9d7505ff5522 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.207106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f092e5-86b7-48c5-8a58-9d7505ff5522 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.221188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/114] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:22.222054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f092e5-86b7-48c5-8a58-9d7505ff5522 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.247833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.249721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a870472-2707-42df-baeb-b0b41b66d203 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.339290 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.359924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f092e5-86b7-48c5-8a58-9d7505ff5522 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.361705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 58/115] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:22.363280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.363811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.364307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.382517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:22.384117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:22.402246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.404287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.404577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.405058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.422399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:22.431793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:22.432776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:22.433538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/116] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:22.434267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.471002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 59/117] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:22.472221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.473929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.559791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7caf192-4527-4622-a0e9-10db08ebf004 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.582068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0063f3-1f25-41ea-aa2d-a7510086ffdc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.595638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.596465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.597179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.597512 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.597788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.617114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:22.625397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:22.626274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:22.627027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/118] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:22.627667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.628502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.629489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.629789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.630074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.634300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.635776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4840209-6eda-4135-9033-19521b4eeaf7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.638306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 60/119] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:22.639359 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11b4-e885-4a9b-95c7-01270ff00d53 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.639646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11b4-e885-4a9b-95c7-01270ff00d53 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.639923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d11b4-e885-4a9b-95c7-01270ff00d53 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.645531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 61/120] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:22.645531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d11b4-e885-4a9b-95c7-01270ff00d53 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.723645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.738588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82afe3ae-e1be-48ed-9487-f55afb9f7898 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.751150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d11b4-e885-4a9b-95c7-01270ff00d53 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.773779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.774505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.774786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.775058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.775861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:22.776209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.777691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.785678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.786368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/121] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:22.786486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.786742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.787019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.789540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.791197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.791520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.794406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 62/122] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:22.797440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.847697 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:22.899160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3f4fa-8709-4f49-ab13-41c01b95669b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.905435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd34f-451d-408d-9c10-c02971e2f593 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:22.936422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.937113 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.937400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.937677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.938517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=9b0e6dd00152428094dc6edbd4c261c5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:22.938833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.940281 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442ab00-b3d5-46dd-9809-70b9844ce8e3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.943855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:22.944525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.944844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.945124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.945813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 63/123] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/role_assignments?user.id=9b0e6dd00152428094dc6edbd4c261c5&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=877094ee517d4ff782d2119eae963315 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:22.947064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:22.947361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:22.947642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:22.952975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:22.953722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:22.955464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:22.968527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/124] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:22.969974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:22.974791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:22.979049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:22.991977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.064977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 64/125] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:23.064977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.125024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16206bc-249a-47c5-9c6d-298ddeedd465 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.132933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.167599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.168451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.168775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.169061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.170531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.172443 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.178904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/126] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:22 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:23.178904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.204842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41521e5-1154-48ac-ae21-c8a3d1b1090c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.254862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.255537 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.255828 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.256111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.257501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.259296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.271651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.296400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf8bf-6c25-4231-9ed9-929ac8efe26c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.332041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.333347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.333805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.334249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.335740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.337439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.339245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/127] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:23.340261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.358748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 65/128] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:44:23 2022] POST /identity/v3/projects => generated 302 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:23.359972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.473038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.482026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799cded-fdfb-4fea-b748-45edf58398c7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.492907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28d879-9326-4010-9a4c-1fc4814a2c2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.523675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.524976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.525465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.526027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.528000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.529785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.532236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 66/129] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:23.538146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.570823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.571791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.571897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.572175 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.587177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:23.596245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:23.597156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:23.597904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/130] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:23.598524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.610878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.662809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb79d8-1bbd-401e-95e4-8e8cee961a5f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.718266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.719264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.719805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.720097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.722035 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.724385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.726193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 67/131] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:23.726964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.728857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb432e-70b6-4d0d-aba6-c98768fb773f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.770184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.771085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.771371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.771653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/users/8faceef41f5540618c0b0bd5ebe3f908/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.772123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:23.773931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, user_id=8faceef41f5540618c0b0bd5ebe3f908, role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.775410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.847485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09085a89-2005-4cc3-aa4e-aab7b92e974b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:23.883343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:23.884027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:23.884307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:23.884586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:23.885584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/132] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:23 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/users/8faceef41f5540618c0b0bd5ebe3f908/roles/e253d3f882df44caa26394cdc954b92a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:23.885691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:23.885845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:23.887286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:23.890312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:23.901255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 68/133] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:23.909535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:24.032993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:24.082725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:24.097986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2ccb-31c1-44ff-9194-dcc1aa32fe46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.098320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78264e-9747-40a8-97a9-640ac0bda5cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.166594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.167536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.167791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.169307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/users/b7bb6edd4f154eb88b778d90110b667e/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.170941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, user_id=b7bb6edd4f154eb88b778d90110b667e, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:24.172430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef8a005-34dd-4e10-8a7b-da6dd6c0edcd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:24.178021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.178932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.179256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.179540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.181409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:24.183416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6939de5-655e-4557-959a-22630427d1e8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:24.185675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 69/134] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:23 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:24.187499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694ea6-a168-4112-b432-0c7c0e156c21 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.187988 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694ea6-a168-4112-b432-0c7c0e156c21 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.188441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9694ea6-a168-4112-b432-0c7c0e156c21 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.194450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 70/135] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:24.195611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9694ea6-a168-4112-b432-0c7c0e156c21 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:24.251275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/136] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:23 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/users/b7bb6edd4f154eb88b778d90110b667e/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:24.253240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.253745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.254259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.289907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:24.291063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:24.382400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9694ea6-a168-4112-b432-0c7c0e156c21 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.419532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/137] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:24.428103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.429054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.429336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.429610 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] PATH_INFO: `/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.430930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] RBAC: Authorizing `identity:get_project(project_id=fa5ea86c5bc8495c9f06ccd73b350ef0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:24.432529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:24.434832 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 71/138] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:24 2022] GET /identity/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:24.440582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:24.467938 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:24.518726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:24.555580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:24.613788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f3894-355e-4969-bd90-a1397f906f07 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.635537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105cc37-3237-470b-b874-519e27df1be2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.654986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.655835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.656131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.656406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.667757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:24.676301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:24.677169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:24.678338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 72/139] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:24.683588 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:24.753910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.754824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.755112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.755396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] PATH_INFO: `/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0/users/8faceef41f5540618c0b0bd5ebe3f908/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.765456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] RBAC: Authorizing `identity:create_grant(project_id=fa5ea86c5bc8495c9f06ccd73b350ef0, user_id=8faceef41f5540618c0b0bd5ebe3f908, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:24.766934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:24.780527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:24.796924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd1af8-1fed-4d39-9ad3-43c052387467 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:24.850824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:24.851428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:24.851725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:24.852001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:24.852789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:24.853099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:24.854503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:24.866875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/140] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:24 2022] PUT /identity/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0/users/8faceef41f5540618c0b0bd5ebe3f908/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:24.872933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 73/141] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:24.878509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:25.010388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233facb-2fdb-4878-ba96-faf2dcdaaedb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:25.031342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:25.051940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:25.053252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.053772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.054250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.055781 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:25.057526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:25.060260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/142] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:24 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:25.065722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:25.209266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934e755-c66b-44ab-a247-82ea9158a8e3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:25.244781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:25.245434 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.245718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.245990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.269651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:25.318930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:25.320520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:25.423055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 74/143] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:25.428571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:25.570209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710ec14-f83d-48de-8d02-3961cd4129a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:25.613545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:25.614409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.614689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.614963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.616287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:25.618579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031aac82-84da-49d4-9957-a31b9e6e2960 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:25.622013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/144] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:25 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:25.626972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:25.685055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:25.731743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8b7ac-5aa7-46fd-957f-1e3522c4f06b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:25.771304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:25.771985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.772272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.772551 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.773449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:25.773763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:25.775267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a83457-35d6-4ee2-baf2-d87150435f12 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:25.782720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 75/145] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:25 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:25.822843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637455fe-8436-40b4-8af7-798a874d4a7f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.823127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637455fe-8436-40b4-8af7-798a874d4a7f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.823311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637455fe-8436-40b4-8af7-798a874d4a7f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.825393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/146] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:25.831022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:25.831333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:25.831589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:25.851566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:25.852820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:25.930098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 76/147] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:25.953405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637455fe-8436-40b4-8af7-798a874d4a7f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.032344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:26.097393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637455fe-8436-40b4-8af7-798a874d4a7f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:26.145357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:26.146174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.146458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.146735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:26.169374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:26.170505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:26.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/148] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:26.176728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.234082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:26.307824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426295-b6eb-4a19-8684-0e2ec52cbe58 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:26.353411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:26.354013 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.354307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.354591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.355348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:26.355720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:26.357638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00cdde-6d00-41b7-9fb3-a350ddbc9526 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:26.366864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 77/149] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:26.373432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.534860 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd36d5a-1c1f-4e55-b507-e0666badff18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:26.540223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14d17-36f9-403c-9468-4763a03ea07a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.540509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14d17-36f9-403c-9468-4763a03ea07a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.540818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f14d17-36f9-403c-9468-4763a03ea07a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.542183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 78/150] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:26.547891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.548178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.548455 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.558568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:26.571278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:26.573292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:26.597360 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:26.598247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.598531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.598808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] PATH_INFO: `/v3/users/9b0e6dd00152428094dc6edbd4c261c5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.600058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0e6dd00152428094dc6edbd4c261c5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:26.601537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:26.609295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/151] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:26 2022] GET /identity/v3/users/9b0e6dd00152428094dc6edbd4c261c5 => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:26.610591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.695834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 79/152] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:26.739308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.777436 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420afee-0479-4ddf-a368-1e04f40dfa36 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:26.795183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:26.837806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c543d4-f872-4562-aad6-49358186908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:26.838874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c543d4-f872-4562-aad6-49358186908f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.839159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c543d4-f872-4562-aad6-49358186908f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.839431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c543d4-f872-4562-aad6-49358186908f None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.841747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c543d4-f872-4562-aad6-49358186908f None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:26.843449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c543d4-f872-4562-aad6-49358186908f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:26.849511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/153] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:26 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:26.855363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c543d4-f872-4562-aad6-49358186908f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:26.894633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c65ca-af49-4207-8ab6-f80de10dfe10 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:26.950817 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:26.960711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:26.961511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:26.961799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:26.962066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:26.964608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:26.966613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:26.969176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 80/154] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:26.973824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:27.053032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c543d4-f872-4562-aad6-49358186908f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.133393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:27.134319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.134604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.134875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/users/9b0e6dd00152428094dc6edbd4c261c5/roles/877094ee517d4ff782d2119eae963315` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.139153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, user_id=9b0e6dd00152428094dc6edbd4c261c5, role_id=877094ee517d4ff782d2119eae963315)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:27.140607 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c5a71-b305-499c-be27-746d5d97a87a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:27.147194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a666-068f-4522-9984-e9c870ff7747 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.150296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:27.182180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:27.182855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.183139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.183416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.184712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:27.186169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:27.220685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/155] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:26 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/users/9b0e6dd00152428094dc6edbd4c261c5/roles/877094ee517d4ff782d2119eae963315 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:44:27.220685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609f54-7038-4e07-ab69-e3ca50cbd597 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.220685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609f54-7038-4e07-ab69-e3ca50cbd597 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.220685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609f54-7038-4e07-ab69-e3ca50cbd597 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.220685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/156] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:27.227585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.228180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.228693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.248574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:27.250207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:27.295123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 81/157] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:26 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:27.352685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/158] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:27.391390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:27.539630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194520c-ff71-4339-b16b-8bd20c90c7a4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.582926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:27.583751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.584039 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.584320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.595814 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0e2a254f-d68a-46a3-995e-3c587dbf775b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:27.603933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:27.604825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:27.606207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 82/159] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:27.613354 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:27.626428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ae38a-e968-4837-b677-cdbaad5013fb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.626722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ae38a-e968-4837-b677-cdbaad5013fb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.627030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ae38a-e968-4837-b677-cdbaad5013fb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.628686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 83/160] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:27.633641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.633923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.634198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.652236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:27.654238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:27.670111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:27.674626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:27.743493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 84/161] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:27.766581 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95da897-42f6-4366-b24b-c877c0a2795a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.774125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:27.823558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:27.826247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.826751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.827226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.828307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:27.828881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:27.830649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:27.842685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/162] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:27.848812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:27.915400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4dc63d-848b-400c-987f-756c89cc08f5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.968265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:27.969094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.969372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.969651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:27.984194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:27.990458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d7c06208-48d2-4b6d-bd00-6b31f6e487b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:27.991877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:27.992715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:27.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:27.994331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 85/163] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:27.995454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7ad0b-5d95-4054-8934-3bae2b48d1a8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:27.995561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d0a-2e1e-47b0-8fc1-0c406d0130a0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:27.995724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d0a-2e1e-47b0-8fc1-0c406d0130a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:27.997731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c95d0a-2e1e-47b0-8fc1-0c406d0130a0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.002606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 86/164] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:28.003428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c95d0a-2e1e-47b0-8fc1-0c406d0130a0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.019362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.044649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.045979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.046269 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.047410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.048787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.050641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0c59f-b8d5-4d28-a863-84136ce7eea7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.052854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/165] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:27 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:28.054061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.054342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.054968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.076749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:28.078012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:28.132206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c95d0a-2e1e-47b0-8fc1-0c406d0130a0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.163227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/166] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:28.164402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.169335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.170257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.170538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.170812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.171568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:28.171876 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.173332 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.182119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 87/167] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:28.187615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.263163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.280124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.284363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db1a0-2a43-4518-8fb4-3e4317fe7606 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.293745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5641ce-6c28-43e8-acba-466ec3eb0a27 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.327091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.328069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.328566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.329164 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.336848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.337720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.338001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.338273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] PATH_INFO: `/v3/users/b7bb6edd4f154eb88b778d90110b667e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.339484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] RBAC: Authorizing `identity:get_user(user_id=b7bb6edd4f154eb88b778d90110b667e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.342053 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.343181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 88/168] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/users/b7bb6edd4f154eb88b778d90110b667e => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:28.343945 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.425955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.427895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.467226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e5e42-0560-4494-ac94-6efdc7b60b4e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.507807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.508604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.508920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.509192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.519189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.522145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:28.533458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:28.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 89/169] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:28.539641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.563235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/170] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:28.567972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.569217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.724999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196390b-f148-4aee-b303-0b6ce720814b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.750476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0f1aa-7522-4a07-9617-870e6e8cbb91 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:28.792644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.792644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.792644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.792644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.817937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:28.819070 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:28.819597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:28.820016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:28.821001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:28.821576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.823333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.841618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/171] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:28.842844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:28.868905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:28.872833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:28.875147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:28.957988 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:29.013593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 90/172] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:29.017953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:29.044523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b8b4e-bc48-4526-ad11-0a11d561b1ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.127171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.127949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.128230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.128502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.137557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.139114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.140996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/173] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:28 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:29.141868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:29.165045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb6a2a-44c7-44ff-a5ac-f30bd032c405 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.166621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:29.200096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.201062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.201531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.201862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] PATH_INFO: `/v3/users/8faceef41f5540618c0b0bd5ebe3f908` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.203192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] RBAC: Authorizing `identity:get_user(user_id=8faceef41f5540618c0b0bd5ebe3f908)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.204646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.206808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 91/174] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/users/8faceef41f5540618c0b0bd5ebe3f908 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:29.207351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:29.307379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca95c-6bb8-490e-97d0-bab74644bb23 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.342464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.343204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.343390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.343664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.344496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:29.344837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.346306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.346909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28042dc-c362-480a-8bf8-a2db96153b88 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.352843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 92/175] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=e253d3f882df44caa26394cdc954b92a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:29.353983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:29.409032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:29.418698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:29.429310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.430202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.430479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.430754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.436252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.437786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.439656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/176] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:29.452062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:29.602845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765851cd-846d-4f15-b065-10d1a3181f22 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.688771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7989-cb0a-4873-be9b-d9d7293299f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:29.715953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.717107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.718199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.723680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.773210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:29.773989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:29.774398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:29.774686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:29.775525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=b7bb6edd4f154eb88b778d90110b667e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:29.775834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.778086 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.795235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/177] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/role_assignments?user.id=b7bb6edd4f154eb88b778d90110b667e&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:29.848051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:29.850034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:29.893618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:29.983792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 93/178] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:29.988893 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:30.075616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:30.126720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38053a-7f0b-4df2-a67b-519260f260b2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:30.164465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:30.165359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.165639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.165914 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] PATH_INFO: `/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.168525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=fa5ea86c5bc8495c9f06ccd73b350ef0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:30.170278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995273-4cc6-4e0a-a98f-d23e1c336bb8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:30.171999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/179] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:29 2022] GET /identity/v3/projects/fa5ea86c5bc8495c9f06ccd73b350ef0 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:30.180465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:30.304608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8dd5e-31c2-410b-9d44-21dc44110651 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:30.340699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:30.346185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:30.346847 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.347131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.347409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.348276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=fa5ea86c5bc8495c9f06ccd73b350ef0, user.id=8faceef41f5540618c0b0bd5ebe3f908) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:30.348594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:30.350056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a18b-8992-4b9b-9ee6-e4853c219753 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:30.359351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 94/180] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:30 2022] GET /identity/v3/role_assignments?user.id=8faceef41f5540618c0b0bd5ebe3f908&scope.project.id=fa5ea86c5bc8495c9f06ccd73b350ef0&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:30.612222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e49d4-82d1-44fd-b3d7-245fa9def7da None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.612872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e49d4-82d1-44fd-b3d7-245fa9def7da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.613347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e49d4-82d1-44fd-b3d7-245fa9def7da None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.615012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/181] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:30.623626 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.624227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.624723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.643372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:30.644912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:30.701037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124f8e-22b4-4dac-939b-d635179f1bd6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.701661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124f8e-22b4-4dac-939b-d635179f1bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.702008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4124f8e-22b4-4dac-939b-d635179f1bd6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.703601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/182] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:30.709396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.709396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.709628 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.725458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 95/183] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:30.732045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:30.733507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:30.755988 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:30.824208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/184] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:30.852466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:30.896133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be296a9c-5b95-4ae7-9ca5-bfa1abd547bc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:30.921482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:30.939043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:30.950270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:30.952274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:30.952812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:30.953313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:30.970284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:30.977381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0406b-981e-4c38-8070-b233f5e0912e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:30.982522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:30.983735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:30.984528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:30.992185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 96/185] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:30.993807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.027643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.028497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.028875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.029389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.041034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:31.050994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:31.051898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:31.052710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/186] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:31.060269 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.116404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fdf55-2399-4113-bb9d-098474281b98 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.153317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.154461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.154950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.155488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.156460 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:31.157028 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.158815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.167048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836ce6a-af4e-4ea6-999e-0b4ac928b864 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.168977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 97/187] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:31.175557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.194789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.217159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.218174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.218458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.218747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.220103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:31.220418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.221855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.238733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/188] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:31.240767 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.245888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.316600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207db3-c072-4426-9367-f68e6a89208a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.366862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.367843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.368130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.368406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] PATH_INFO: `/v3/users/9b0e6dd00152428094dc6edbd4c261c5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.369654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] RBAC: Authorizing `identity:get_user(user_id=9b0e6dd00152428094dc6edbd4c261c5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.371786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa9481-8dc5-42c2-9d25-c07a28301968 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.373578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 98/189] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/users/9b0e6dd00152428094dc6edbd4c261c5 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:31.376645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a497b-7b63-4209-8379-5502b421fa6c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.376645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a497b-7b63-4209-8379-5502b421fa6c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.376645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a497b-7b63-4209-8379-5502b421fa6c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.376645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 99/190] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:31.380871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a497b-7b63-4209-8379-5502b421fa6c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.384053 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4773-fed1-4249-b294-919b66cfd546 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.419501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.420544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.420858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.421137 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.434071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.435526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ca6f6-3cc1-4db3-b479-a1bc20cc6bc9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.437241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/191] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:31.438440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c065c-e45c-4962-923d-4abb6c5eebb3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.438786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c065c-e45c-4962-923d-4abb6c5eebb3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.439071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c065c-e45c-4962-923d-4abb6c5eebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.454489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f57c065c-e45c-4962-923d-4abb6c5eebb3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:31.455683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f57c065c-e45c-4962-923d-4abb6c5eebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:31.484318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a497b-7b63-4209-8379-5502b421fa6c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.485553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.501075 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.518101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.518967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.519074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.519352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.522523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/192] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:31.523824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59caf3-2928-42d6-a713-40cd6b14fc16 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.524116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59caf3-2928-42d6-a713-40cd6b14fc16 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.524396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59caf3-2928-42d6-a713-40cd6b14fc16 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.525857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/193] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:31.529410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59caf3-2928-42d6-a713-40cd6b14fc16 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.591126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.592601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e19d4e-2c9d-4ae2-ac01-ddef5a642193 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.631698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59caf3-2928-42d6-a713-40cd6b14fc16 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.666425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.667071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.667357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.667635 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.690163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 100/194] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:31.691418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.691671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.692040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.702934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.707680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:31.708901 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:31.719985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.736210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.738161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.775109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 101/195] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:31.775949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.835839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/196] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:31.836698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.883675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9fd6d-c036-440a-9fdd-64e9eb418863 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.900594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.916189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.916992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.917272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.917547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.919353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.921079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.922681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 102/197] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:31.922681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:31.932923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757adb03-5bfe-4a92-99bc-41e83b3f118c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:31.942092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:31.969904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:31.970752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:31.971032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:31.971302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:31.972472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:31.973928 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:31.975596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/198] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:31.980440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.023284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06cf4a-ec06-40ae-b31c-63cb4ce125ce None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.056904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.057699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.057978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.058254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.068016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:32.076752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:32.077773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:32.078594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 103/199] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:32.079246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.083357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff024c82-99e1-4a7a-b9a9-a2e7859ea586 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.116591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.117472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.117759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.118038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.119223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.120697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.122788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/200] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:31 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:32.123555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.128543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.154282 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.178557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb54e3-0814-4b0b-a196-a6e49c63febc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.211813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.212404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.212720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.212999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.213760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.215782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.224702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccd910-d64c-41a9-bec1-3041816cc302 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.256689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.257332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.257613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.257884 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.258704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, scope.project.id=166024519ec34edda30537bd1594ab2c, user.id=9b0e6dd00152428094dc6edbd4c261c5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:32.259013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.260430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.266083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/201] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/role_assignments?user.id=9b0e6dd00152428094dc6edbd4c261c5&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=877094ee517d4ff782d2119eae963315 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:32.266843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.315016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 104/202] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:32 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:32.315985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.349859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.394985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd80ca4-9d9f-4436-b4fe-ee8165d30fab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.439644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.440892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.441375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.441844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.442807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:32.443340 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.443791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd732381-3f43-4ed5-9835-fb134b96d904 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.445925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.456397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/203] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:32.462217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.480127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.484678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.485366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.485651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.485926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.486956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=fb40575ffc244cc285c5566bf33366c2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:32.491591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.491591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.497317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 105/204] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/role_assignments?user.id=fb40575ffc244cc285c5566bf33366c2&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:32.583818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9e71a-4020-4f41-8582-271b7889e410 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.623273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.628523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.629682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.629962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.630261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.631539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.633062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.635326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/205] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:32.641493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:32.752992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88330f-00fb-447d-abb5-c8eb354be8cd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:32.787872 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:32.788521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:32.788829 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:32.789104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:32.854152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:32.863055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:32.864828 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:32.971044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 106/206] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:32.977715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:33.085922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30b77f-8fa6-4c42-939c-b18fe3df0049 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:33.126005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:33.127085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:33.127506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:33.127917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:33.129243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:33.130843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479344cf-eb34-4a62-b3d0-380f05138e42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:33.132689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/207] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:32 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:33.141671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:33.239572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:33.247027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504c2e-bfc0-4dd0-b058-5d499a3db5a7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:33.282728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:33.283654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:33.284181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:33.284920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:33.286375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=fb40575ffc244cc285c5566bf33366c2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:33.289492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:33.289492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01a3ce-0c2a-44d7-954a-075cce88659e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:33.295838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 107/208] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:33 2022] GET /identity/v3/role_assignments?user.id=fb40575ffc244cc285c5566bf33366c2&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=e253d3f882df44caa26394cdc954b92a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:34.687157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408504-f241-45eb-adab-5c68f1b9a473 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.688202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408504-f241-45eb-adab-5c68f1b9a473 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.688835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49408504-f241-45eb-adab-5c68f1b9a473 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.690456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/209] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:34.691942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362509-8441-4a84-97c9-86e81b0ea9cc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.692383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362509-8441-4a84-97c9-86e81b0ea9cc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.692483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae362509-8441-4a84-97c9-86e81b0ea9cc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.694091 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 108/210] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:34.700487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.700839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.701088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.702570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50587-f3c6-4e01-818c-980456143363 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.702857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50587-f3c6-4e01-818c-980456143363 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.703178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d50587-f3c6-4e01-818c-980456143363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.720212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:34.720795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-13d50587-f3c6-4e01-818c-980456143363 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:34.722034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-13d50587-f3c6-4e01-818c-980456143363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:34.722270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:34.792570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 109/211] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:34.794648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f226d-c16a-4ed7-85bf-c96774ad409f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.795197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f226d-c16a-4ed7-85bf-c96774ad409f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.795472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f226d-c16a-4ed7-85bf-c96774ad409f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.796970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 110/212] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:34.802283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.802823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.802823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.806362 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:34.807814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/213] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:34.819483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:34.821348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:34.822516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:34.896739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 111/214] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:34.896739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:34.915326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:34.937229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0852-0ac7-4882-a7a9-cbde4a4a304e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:34.973596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:34.974394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:34.974681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:34.974959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:34.987491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:34.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:34.996091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:34.996913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/215] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:34.997569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.012601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2959939-b053-4923-aefa-685ad7ceecd9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.047704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.048504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.048824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.049107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.059692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:35.061425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:35.067321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:35.068424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 112/216] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:35.076232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.115531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4773cec-e22e-460f-9ea1-a3f2dbeb28b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.150049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.152186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.153640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.153899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.154171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.155353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.156834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.158630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/217] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.161885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.178375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e23c5-cd99-46ed-8e09-dade5a214acc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.212805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.213494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.213781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.214058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.215374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:35.215683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.217102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.225666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 113/218] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.231334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.275398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb41c2-2662-44cf-a6fc-b0d2dae8b47d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.300489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.311420 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.312088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.312375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.312677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.313429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:35.313735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.315255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.323904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/219] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.324794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.350950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15073337-8667-4fda-89be-f1d4a2d20b3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.391701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809666b2-19af-4652-96c8-534265d71388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.392481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809666b2-19af-4652-96c8-534265d71388 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.392841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809666b2-19af-4652-96c8-534265d71388 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.393119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809666b2-19af-4652-96c8-534265d71388 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.393884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809666b2-19af-4652-96c8-534265d71388 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.395327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809666b2-19af-4652-96c8-534265d71388 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.407103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.429903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ac63b-d080-4b92-9069-a1fb74a7cca5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.464315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.465287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.465600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.465875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] PATH_INFO: `/v3/users/0c504d2727d6421a96496458326cb19d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.478657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] RBAC: Authorizing `identity:get_user(user_id=0c504d2727d6421a96496458326cb19d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.480157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.482581 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/220] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/users/0c504d2727d6421a96496458326cb19d => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.483341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.493341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 114/221] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:35 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:35.494637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ffb7-c03e-4102-b1b5-25db51615f15 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.494925 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ffb7-c03e-4102-b1b5-25db51615f15 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.495213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21ffb7-c03e-4102-b1b5-25db51615f15 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.497320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 115/222] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:35.498462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ffb7-c03e-4102-b1b5-25db51615f15 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.539588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.604606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c1583-47ca-4dba-8dd3-e59761ca1068 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.627076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21ffb7-c03e-4102-b1b5-25db51615f15 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.646370 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.647249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.647533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.647809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.649058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.650515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362e92a-f8a1-473a-a553-34abbcdb785a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.652169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/223] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.656652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.656652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.656652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.672499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.673229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:35.673377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.673658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.673934 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.674418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:35.749081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.757897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.759367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.763183 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/224] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:35.764388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.851836 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:35.908873 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 116/225] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:35.909970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:35.922950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f8010-e60a-424c-b5d8-923c260b95f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:35.969502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:35.970612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:35.970899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:35.971172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:35.972799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:35.974235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:35.976902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/226] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:35.982163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.029937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.037467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3474f36-96e2-4f16-bd29-c717c6dca240 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.077866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.078669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.078949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.079222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.093153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268faa-a6d8-498a-884a-ee9ebdba28a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.093402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:36.102805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:36.103709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:36.104492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 117/227] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:36.105200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.112906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.150548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.151564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.151939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.152911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.154818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.156862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.159366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/228] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:35 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:36.164382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.232273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ccd4c-eef2-4d0c-b6dd-eace3beed82e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.267985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd787d2-0eed-4d11-afa5-4f5cc560fc9c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.271384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.272580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.273045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.273512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/users/fb40575ffc244cc285c5566bf33366c2/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.275744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, user_id=fb40575ffc244cc285c5566bf33366c2, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.277908 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.306163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.307086 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.307513 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.307961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.309079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:36.309525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.311122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.320075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/229] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:36.321252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.368579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.372478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 118/230] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:36 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/users/fb40575ffc244cc285c5566bf33366c2/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:36.373359 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.413105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.493664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12a2f-8e69-40d3-85c0-26f07a584e18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.537691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.538986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.539511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.539976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.542068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=0c504d2727d6421a96496458326cb19d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:36.542588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.545222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.552909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/231] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:36 2022] GET /identity/v3/role_assignments?user.id=0c504d2727d6421a96496458326cb19d&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:36.586966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0e26-04bb-44c1-a964-1be12304cd25 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.629946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.631200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.631776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.632244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.634657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.636481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.638922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 119/232] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:36 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:36.644965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.768969 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da3a4e-c83c-4048-839d-b7a3bd9cf21b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:36.771367 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.804885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:36.805748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:36.806034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:36.806709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:36.807888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:36.810123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24b94-730f-4a7c-986c-cfa5ef626efb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:36.812465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/233] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:36 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:36.818017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:36.960447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:36.981008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa5a889-7246-4f6b-b343-7566574bdbe4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:37.029151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:37.029973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:37.030257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:37.030529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/users/fb40575ffc244cc285c5566bf33366c2/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:37.033956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, user_id=fb40575ffc244cc285c5566bf33366c2, role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:37.035415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfad1-ae12-4264-adf2-3c15e92f2437 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:37.111253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 120/234] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:36 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/users/fb40575ffc244cc285c5566bf33366c2/roles/e253d3f882df44caa26394cdc954b92a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:38.389417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a61b3-9828-4d1a-9e3a-0bd7baa450a6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.389931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a61b3-9828-4d1a-9e3a-0bd7baa450a6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.390006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a61b3-9828-4d1a-9e3a-0bd7baa450a6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.391478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/235] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:38.396402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.396843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.397008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.406327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadf0b-31b6-438b-be76-74529787a0b0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.406601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadf0b-31b6-438b-be76-74529787a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.406876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfadf0b-31b6-438b-be76-74529787a0b0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.408366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/236] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:38.413497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814b94-0527-4414-9852-bbece5990c7a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.413783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814b94-0527-4414-9852-bbece5990c7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.414056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814b94-0527-4414-9852-bbece5990c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.425732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:38.426924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:38.444937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-84814b94-0527-4414-9852-bbece5990c7a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:38.446112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84814b94-0527-4414-9852-bbece5990c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:38.534511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/237] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:38.553906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 121/238] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:38.577401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84814b94-0527-4414-9852-bbece5990c7a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:38.589468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:38.709251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:38.718432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84814b94-0527-4414-9852-bbece5990c7a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:38.728500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5f087-4a35-4e1a-96d8-5c7211c4824c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:38.729042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:38.765002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:38.765799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.766084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.766358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:38.771923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:38.775976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 122/239] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:38.780259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:38.801841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:38.802981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.803480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.803945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.833510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:38.848650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:38.849563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:38.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:38.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/240] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:38.858685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:38.886002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714270e-1577-4a71-ab3b-8af7d5c71c47 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:38.921020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:38.921688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:38.921975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:38.922246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:38.922958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:38.924401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:39.014049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57de34e-5e04-4e78-81b3-b1b136ca7f98 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.041377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:39.051794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 123/241] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:38 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:39.062116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:39.063203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.063695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.064198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.065226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:39.065747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:39.067493 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c953d9-0a59-4f47-92ca-c4cc94ca550a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:39.083742 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/242] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:39.102976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:39.171176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8f33-7bf7-4bac-bf27-ebca7f35156a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.171859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8f33-7bf7-4bac-bf27-ebca7f35156a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.172350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc8f33-7bf7-4bac-bf27-ebca7f35156a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.174245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/243] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:39.182742 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316466-d7a1-4d2f-be90-acd69d60ae78 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.183430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316466-d7a1-4d2f-be90-acd69d60ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.183916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3316466-d7a1-4d2f-be90-acd69d60ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.217465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3316466-d7a1-4d2f-be90-acd69d60ae78 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:39.219027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3316466-d7a1-4d2f-be90-acd69d60ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:39.238905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d6da5-f6ab-49aa-83f4-894c8fce6529 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.241524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:39.284555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:39.285453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.285733 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.286005 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] PATH_INFO: `/v3/users/0daa1890e44f4cc9889f585b0559d729` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.378046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0daa1890e44f4cc9889f585b0559d729)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:39.380295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120465c0-809e-440e-ae8d-e9d6128eb9f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:39.382653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 124/244] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:39 2022] GET /identity/v3/users/0daa1890e44f4cc9889f585b0559d729 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:39.384412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11657cf-9cb0-48e5-9509-865d9053512c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.384741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11657cf-9cb0-48e5-9509-865d9053512c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.385018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11657cf-9cb0-48e5-9509-865d9053512c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.389159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 125/245] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:39.390017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11657cf-9cb0-48e5-9509-865d9053512c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:39.409755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/246] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:39.411050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.411338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.411616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.454072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:39.455604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:39.505635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:39.557311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11657cf-9cb0-48e5-9509-865d9053512c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.571336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/247] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:39.572031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:39.625452 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:39.626130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.626414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.626690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.717548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:39.733475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391b5bb-3f4a-482c-ab66-f76d94fa15bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.734453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:39.735976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d7998-66f3-4a92-b5e4-5a5cf9120a32 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:39.769561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:39.770448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.770734 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.771103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.782785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:39.790814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:39.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:39.793245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/248] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:39.794486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:39.794571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:39.845818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 126/249] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:39.847146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402cf0-a59c-4d7d-9730-cb89825a5f41 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.847435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402cf0-a59c-4d7d-9730-cb89825a5f41 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.847712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44402cf0-a59c-4d7d-9730-cb89825a5f41 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.849060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 127/250] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:39.849751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402cf0-a59c-4d7d-9730-cb89825a5f41 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:39.919789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afd7ca-05b6-4f97-81c5-3b0869b57747 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.963569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44402cf0-a59c-4d7d-9730-cb89825a5f41 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:39.968971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:39.970040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:39.970540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:39.971010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:39.986038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:39.999493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:40.000100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:40.000976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:40.001765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:40.002357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.002357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.002357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.002357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:40.002357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee83ed-69ee-46ba-b363-2f4a921c382c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.005570 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/251] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:40.006626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.012709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.012862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 128/252] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.014512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.014512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.014686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.032543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:40.033787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:40.048904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.106736 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 129/253] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:40.107495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.140924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3cc18-38c8-409c-a1a1-eb77d8510f6f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.188381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.190233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.190973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.191463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.193604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.195292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.198342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/254] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.199298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.237943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ba022-4922-41f0-8dd0-276df51f3b4c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.272878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.273690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.274075 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.274443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.275286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:40.275893 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.277299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.285598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 130/255] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.286584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.294054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.300228 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.335625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ef510-56f3-4f4e-a481-533360d0fa1f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.381704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.383053 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.383841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.384502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] PATH_INFO: `/v3/users/0c504d2727d6421a96496458326cb19d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.386183 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] RBAC: Authorizing `identity:get_user(user_id=0c504d2727d6421a96496458326cb19d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.388417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.397940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/256] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/users/0c504d2727d6421a96496458326cb19d => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.397940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.398129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5fa59-63d1-4972-ba49-d3e7890025a1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.430629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.431572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.431982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.432352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.444261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:40.452870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:40.453849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:40.454638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 131/257] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:40.460056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.509191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6508-ea7a-4c23-b757-d023fd2655e9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.535143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.545678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.546532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.546835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.547208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.548136 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=0daa1890e44f4cc9889f585b0559d729) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:40.548553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.550208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.556274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/258] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/role_assignments?user.id=0daa1890e44f4cc9889f585b0559d729&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=877094ee517d4ff782d2119eae963315 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.557054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.582494 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.603539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8ffcf-ae49-4499-a0c3-f83797b0c6c7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.681222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ec018-0edb-4179-a49a-ea4ecebe664a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.718418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.719547 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.719930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.720314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.721775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.723342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.725677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/259] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.726613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.745373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.746305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.746589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.746866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.753492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.754963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.756990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 132/260] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.757806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.814554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:40.852476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c89b27-8cc3-4dd9-9dab-054dea602b18 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:40.893450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:40.894127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:40.894414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:40.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:40.895878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:40.896190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:40.897619 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:40.907289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/261] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:40.908470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:40.958835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c23e2-a8e3-498c-bcc5-c86580d15bf9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.027941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed366fb2-29c9-4784-8b56-bb86ad3d9008 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.049897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.050851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.051186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.051463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/users/0c504d2727d6421a96496458326cb19d/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.057980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, user_id=0c504d2727d6421a96496458326cb19d, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.059989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.066696 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.067777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.068298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.068589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.071537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.129090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.138274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 133/262] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:40 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/users/0c504d2727d6421a96496458326cb19d/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:41.139608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:41.148016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.149707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.312570 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/263] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:41.313945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:41.328598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390afad-061a-4f7f-87c6-40a554f3329d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.364497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.368369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.369444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.369897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.370306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] PATH_INFO: `/v3/users/fb40575ffc244cc285c5566bf33366c2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.372392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] RBAC: Authorizing `identity:get_user(user_id=fb40575ffc244cc285c5566bf33366c2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.374061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.375922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 134/264] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:41 2022] GET /identity/v3/users/fb40575ffc244cc285c5566bf33366c2 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:41.385942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:41.488340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.530628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8b21-cc64-49d1-93cf-a556fa9df03d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.532927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555bc3d-8197-4290-bfcb-956ed71372cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.566697 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.567261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.567542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.567819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.572830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.573858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.574307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.574753 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.576096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.578309 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdbab-a65a-44ca-b504-dd6b83af675e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.581335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/265] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:41 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:41.582695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682fe2-f29d-4a89-b831-2104b49fa5aa None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.583124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682fe2-f29d-4a89-b831-2104b49fa5aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.583536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682fe2-f29d-4a89-b831-2104b49fa5aa None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.585246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/266] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:41.589432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682fe2-f29d-4a89-b831-2104b49fa5aa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:41.647259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.648752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ca183-1816-4564-a93f-36e4fc71e730 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.721033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.770087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682fe2-f29d-4a89-b831-2104b49fa5aa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:41.771828 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:41.809631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 135/267] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 10 12:44:41.810638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:41.810957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4df8-74ef-4356-b208-09390d5d06d3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.811244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4df8-74ef-4356-b208-09390d5d06d3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.811353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:41.811518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4df8-74ef-4356-b208-09390d5d06d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.811627 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:41.811823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:41.812701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=fb40575ffc244cc285c5566bf33366c2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:41.813017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:41.814565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:41.823739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/268] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:41 2022] GET /identity/v3/role_assignments?user.id=fb40575ffc244cc285c5566bf33366c2&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:41.829487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:41.845837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4c8e4df8-74ef-4356-b208-09390d5d06d3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:41.847086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4c8e4df8-74ef-4356-b208-09390d5d06d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:42.001589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 136/269] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:42.002975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d501-5bc4-4fc8-b3d4-7327efc70b97 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.003263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d501-5bc4-4fc8-b3d4-7327efc70b97 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.003536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1d501-5bc4-4fc8-b3d4-7327efc70b97 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.005428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 137/270] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:42.011670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.011976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.012289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.031690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca49655-6155-482b-8b44-ff377f3b2dc7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.032512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:42.040647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:42.094387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.095330 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.095620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.095895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.098213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.099941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.103373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/271] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:41 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:42.104657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.129075 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 138/272] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:42.130335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.166011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:42.180835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:42.257814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd4f77-37dd-483f-b8eb-f663151bc80c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.270562 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e2d73-2e38-48c2-b71a-0d61c0d47bab None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.308889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.309981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.310759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.311206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.316966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.317712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.318108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.318450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.319413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=fb40575ffc244cc285c5566bf33366c2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:42.319794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.322550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.325336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:42.329825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 139/273] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/role_assignments?user.id=fb40575ffc244cc285c5566bf33366c2&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=e253d3f882df44caa26394cdc954b92a => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:42.330712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:42.340210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:42.341172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:42.341941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:42.347375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/274] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:42.353209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.515059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:42.531598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41663a4-e554-41c0-a058-c8e0a69a5862 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.552212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:42.561712 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46647-cbc0-4297-8ed4-9dcb6810b81e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.582632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.584067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.584507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.584997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.586574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.588280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.591198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 140/275] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:42.598043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.615470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.616909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.617633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.618323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.619879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:42.620603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.623464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.633453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/276] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:42.638746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.720178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c73ba-d1ac-4f6b-89b6-077d393f09d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.759045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.759768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.760052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.760362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.761105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.764846 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3b473-845a-45ce-9ca4-c499fb76041a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.783728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba19de-82b9-4a7e-b85e-7edb843070a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:42.819410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:42.820668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:42.821206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:42.821674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] PATH_INFO: `/v3/users/d2e177e7457743108268f0b0d1213165` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:42.836043 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e177e7457743108268f0b0d1213165)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:42.837818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:42.840688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/277] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/users/d2e177e7457743108268f0b0d1213165 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:42.859009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:42.859206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 141/278] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:44:42 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:44:42.868236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:42.964103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ca4b14-a554-47e4-af39-b2c398604200 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:43.001903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:43.002564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.002841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.003113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.003954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, user.id=d2e177e7457743108268f0b0d1213165, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:43.004263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:43.005752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14189ac4-00bf-4f16-bdf3-03574c0a8cf0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:43.012777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/279] 10.222.0.10 () {56 vars in 1308 bytes} [Fri Jun 10 12:44:42 2022] GET /identity/v3/role_assignments?user.id=d2e177e7457743108268f0b0d1213165&scope.system=all&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:43.306930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f768d-dcdd-4abe-bc33-ea944219513f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.307301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f768d-dcdd-4abe-bc33-ea944219513f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.307498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f768d-dcdd-4abe-bc33-ea944219513f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.309301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 142/280] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:43.315108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.315409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.315692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.334184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:43.335396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:43.426983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/281] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:43.466815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f768d-dcdd-4abe-bc33-ea944219513f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:43.484464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:43.638657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f768d-dcdd-4abe-bc33-ea944219513f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:43.697321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:43.698131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.698413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.698684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.718891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4780655d-0759-4a4a-93dc-589021790431 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:43.726669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:43.727535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:43.728329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 143/282] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:43.735722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:43.751144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:43.826947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d585f-102b-4abe-a874-47187ba53868 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.827266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d585f-102b-4abe-a874-47187ba53868 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.827497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d585f-102b-4abe-a874-47187ba53868 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.828915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 144/283] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:43.834680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.834967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.835246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.856199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:43.857465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:43.894100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae31f8-6542-4325-b4c2-99bcc7723d61 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:43.964491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:43.965267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:43.965548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:43.965816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:43.967006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:43.967311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:43.968712 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:43.971250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 145/284] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:43.984602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/285] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:43.989851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:43.993456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.027081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.100895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.132231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59578d-4318-4cc6-8153-38135875dda1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.168075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.168880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.169165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.169441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.169605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc695ba-476c-4b69-a349-659becc22506 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.180307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:44.188557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:44.189435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:44.190215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/286] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:44.195632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.264816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.265824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.266117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.266397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] PATH_INFO: `/v3/users/0daa1890e44f4cc9889f585b0559d729` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.267692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] RBAC: Authorizing `identity:get_user(user_id=0daa1890e44f4cc9889f585b0559d729)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.269621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.272642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 146/287] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:43 2022] GET /identity/v3/users/0daa1890e44f4cc9889f585b0559d729 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:44.281629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.309961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70611cb4-fb2c-4ec7-a710-062369ec0851 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.344211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.351994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.353083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.360418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.360418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.360418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:44.360418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.360418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.367874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/288] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:44.373632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.461079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.491851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e19a25-6f91-4485-81f4-da7abe43ebbc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.531376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5aa5-f7dc-47a1-9c19-b83d3479eccd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.531958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.533337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.533817 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.534297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] PATH_INFO: `/v3/users/0c504d2727d6421a96496458326cb19d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.535688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c504d2727d6421a96496458326cb19d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.538173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.540299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/289] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/users/0c504d2727d6421a96496458326cb19d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:44.545635 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.621481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.647143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.648020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.648308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.648587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.653204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.654703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.656487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 147/290] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:44.664994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fd533-6194-49c6-9fa7-1a5b519d27a6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.665484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.703224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.704186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.704730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.707233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.802984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.805228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.856973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18878e11-e139-465f-9021-3a48befbe5f2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:44.891751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:44.892835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:44.893352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:44.893721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/users/0daa1890e44f4cc9889f585b0559d729/roles/877094ee517d4ff782d2119eae963315` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:44.895936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, user_id=0daa1890e44f4cc9889f585b0559d729, role_id=877094ee517d4ff782d2119eae963315)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:44.897499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:44.902991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.954449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/291] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:44.965054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:44.970122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:44.977684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 148/292] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:44:44 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/users/0daa1890e44f4cc9889f585b0559d729/roles/877094ee517d4ff782d2119eae963315 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:45.111319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43539e37-40d7-4579-8805-eae46450ba62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:45.156801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:45.158078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.158561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.159041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.160959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:45.162598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1335b7c-f8a8-4f67-a70c-f4285c4c00dc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:45.164834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/293] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:44 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:45.171904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:45.282760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2691add-7d7e-4d2d-9047-d60d5cb0eba9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:45.323345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:45.325335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.325831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.326307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.327356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=0c504d2727d6421a96496458326cb19d) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:45.327868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:45.329617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7d353-6d40-461a-b66b-0785b9595980 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:45.341453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 149/294] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:45 2022] GET /identity/v3/role_assignments?user.id=0c504d2727d6421a96496458326cb19d&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:45.596538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede33e-573b-416e-a8ab-c55fbf11656b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.597309 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede33e-573b-416e-a8ab-c55fbf11656b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.597794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ede33e-573b-416e-a8ab-c55fbf11656b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.599785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/295] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:45.606338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcde6-c859-4a48-8cf2-3b6929b4cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.606973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcde6-c859-4a48-8cf2-3b6929b4cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.607476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbcde6-c859-4a48-8cf2-3b6929b4cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.634401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f5bbcde6-c859-4a48-8cf2-3b6929b4cdc0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:45.635969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f5bbcde6-c859-4a48-8cf2-3b6929b4cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:45.647687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e779-82d1-455b-ab64-9339c2127640 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.648027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e779-82d1-455b-ab64-9339c2127640 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.648250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514e779-82d1-455b-ab64-9339c2127640 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.649897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/296] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:45.656771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.657076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.657344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.686631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:45.687866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:45.717728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:45.725659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:45.728064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 150/297] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:45.741677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad559ae-2e4d-4bf5-b793-bbfe6d20a570 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.741965 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad559ae-2e4d-4bf5-b793-bbfe6d20a570 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.742248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad559ae-2e4d-4bf5-b793-bbfe6d20a570 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.743745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 151/298] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:44:45.750761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.751096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.751383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.778316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:45.779677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:45.804769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/299] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:45.806252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:45.874887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 152/300] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:45.876124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:45.929784 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3460fe0-eec7-4075-827d-26ff2dd55868 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:45.968878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:45.970024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:45.970306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:45.970580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:45.982774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:45.990428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:45.991304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:45.992081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:45.995320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8494a-bf08-423e-b588-49d39890234e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:45.996910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/301] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:45.998171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.020684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.020992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.031380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.032185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.032469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.032776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.044229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:46.052283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:46.053379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:46.054352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 153/302] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:46.056657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.114939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3810f-e54a-4720-b75d-7975d4cf394e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.151938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.152750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.153026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.153300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.154477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.155932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.157739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/303] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:46.158418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.164520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339a24-86c7-4ef7-9a1a-9e97580d34da None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.200665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.201327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.201605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.201879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.202609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:46.202912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.204280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.213363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 154/304] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:46.214203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.246596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.262662 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76298-3fa0-4085-87fb-acf65cf80f70 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.267287 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.301276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.301994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.302283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.302563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.303342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:46.303651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.305054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.315038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/305] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:46.315748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.326745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744ec28-b48c-457c-85a9-cbbd4ad14547 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.362782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.363789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.364392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.364392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] PATH_INFO: `/v3/groups` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.365251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.366752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.420953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 155/306] 10.222.0.10 () {60 vars in 1134 bytes} [Fri Jun 10 12:44:46 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:44:46.421793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.435353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d0faf-8554-4b1b-88cb-35a611cac3b6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.488265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.490238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.490680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.491119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] PATH_INFO: `/v3/users/d2e177e7457743108268f0b0d1213165` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.492666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e177e7457743108268f0b0d1213165)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.495489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.502549 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/307] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:46 2022] GET /identity/v3/users/d2e177e7457743108268f0b0d1213165 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:46.503785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.536301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.556672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606bf8d-5cce-4100-abe0-b72ae0a15bae None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.565756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:46.599160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.600195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.600759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.601111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] PATH_INFO: `/v3/users/d5ca074ea9f04027af5b87ca22942fc6` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.619754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] RBAC: Authorizing `identity:get_user(user_id=d5ca074ea9f04027af5b87ca22942fc6)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.622596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.625865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 156/308] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:46 2022] GET /identity/v3/users/d5ca074ea9f04027af5b87ca22942fc6 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:46.630839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:46.658975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6cab1-becb-4b96-a51f-db06bc3b3917 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.708935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.710335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.710796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.711246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] PATH_INFO: `/v3/system/users/d2e177e7457743108268f0b0d1213165/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.713829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d2e177e7457743108268f0b0d1213165, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.716254 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4129f02-8ccd-454a-94d3-bc75a4c6a9f6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.748599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9b29e-43be-47d6-9826-688fe0f2342c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:46.784978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:46.785663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:46.785953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:46.786307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:46.787150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, user.id=d5ca074ea9f04027af5b87ca22942fc6, scope.system=all) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:46.787465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:46.788932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3fdf9-4700-44fd-84c4-cb92745c45da None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:46.795054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 157/309] 10.222.0.10 () {56 vars in 1308 bytes} [Fri Jun 10 12:44:46 2022] GET /identity/v3/role_assignments?user.id=d5ca074ea9f04027af5b87ca22942fc6&scope.system=all&role.id=877094ee517d4ff782d2119eae963315 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:46.806968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/310] 10.222.0.10 () {58 vars in 1334 bytes} [Fri Jun 10 12:44:46 2022] PUT /identity/v3/system/users/d2e177e7457743108268f0b0d1213165/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:44:47.398405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e2c9-defc-4252-96ed-c01bcb682f95 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:47.398702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e2c9-defc-4252-96ed-c01bcb682f95 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:47.398981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e2c9-defc-4252-96ed-c01bcb682f95 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:47.400505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 158/311] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:47.406352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:47.406646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:47.406930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:47.423863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:47.425093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:47.498199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/312] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:47.521937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e2c9-defc-4252-96ed-c01bcb682f95 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:47.552476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:47.631723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e2c9-defc-4252-96ed-c01bcb682f95 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:47.671168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:47.671920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:47.672211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:47.672483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:47.683117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:47.690866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:47.691725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:47.692496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 159/313] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:47.700344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:47.712561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:47.805455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46cbbc-f60b-4368-877c-e3a1803062c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:47.845235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:47.845982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:47.846177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:47.846450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:47.847192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:47.847497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:47.848892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:47.858185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/314] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:47.865721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:47.965079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:47.977431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29b950-cfbb-4962-b18d-980fae029b36 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:48.012398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:48.013298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.013578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.013854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] PATH_INFO: `/v3/users/0daa1890e44f4cc9889f585b0559d729` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.015065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] RBAC: Authorizing `identity:get_user(user_id=0daa1890e44f4cc9889f585b0559d729)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:48.016515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:48.018331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 160/315] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:47 2022] GET /identity/v3/users/0daa1890e44f4cc9889f585b0559d729 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:48.025706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:48.099504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:48.132963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff097b3-4d62-494e-adba-51530fbc3963 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:48.172057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:48.173088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.173588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.174059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.241026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:48.242863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:48.325438 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:48.344435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/316] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:48.353703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:48.459857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49199fbf-5c44-4d82-ae6f-eb68dfb64fea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:48.496152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:48.496966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.497252 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.497528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.498728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:48.500183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0fcf2-c765-4e43-ba90-5a27624b64d0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:48.502065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 161/317] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:48 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:48.509697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:48.616090 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adae2e-8dd4-45f9-9a2f-64e712c66fb9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:48.651722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:48.653111 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.653474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.653750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.654589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, scope.project.id=17ad6fd92442448db5154fbd88412cea, user.id=0daa1890e44f4cc9889f585b0559d729) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:48.654900 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:48.656347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458fb4-f4b5-4044-982e-f67e04a3636f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:48.662836 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/318] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:44:48 2022] GET /identity/v3/role_assignments?user.id=0daa1890e44f4cc9889f585b0559d729&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=877094ee517d4ff782d2119eae963315 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:48.752585 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5ad6-da63-4608-ac68-1d31e97bb57a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.752909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5ad6-da63-4608-ac68-1d31e97bb57a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.753092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab5ad6-da63-4608-ac68-1d31e97bb57a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.754666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 162/319] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:48.760343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a66ed-36c6-4a0a-b316-4d7a9fe1e482 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:48.761005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a66ed-36c6-4a0a-b316-4d7a9fe1e482 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:48.761568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a66ed-36c6-4a0a-b316-4d7a9fe1e482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:48.779983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b63a66ed-36c6-4a0a-b316-4d7a9fe1e482 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:48.781572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b63a66ed-36c6-4a0a-b316-4d7a9fe1e482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:48.814417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:48.855022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/320] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:48.879511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab5ad6-da63-4608-ac68-1d31e97bb57a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:48.908801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:48.997081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab5ad6-da63-4608-ac68-1d31e97bb57a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.034089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.034894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.035173 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.035444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.036700 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.038176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.039990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 163/321] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:44:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:49.042025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172287-af1e-44a1-b34c-3a96aaa4b1c1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.042327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172287-af1e-44a1-b34c-3a96aaa4b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.043185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7172287-af1e-44a1-b34c-3a96aaa4b1c1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.045626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/322] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:49.046641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.050448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92a8e-5358-432a-95c8-e8b6abb7581e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.050737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92a8e-5358-432a-95c8-e8b6abb7581e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.051012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc92a8e-5358-432a-95c8-e8b6abb7581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.067445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2dc92a8e-5358-432a-95c8-e8b6abb7581e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:49.068606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dc92a8e-5358-432a-95c8-e8b6abb7581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:49.135485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/323] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:49.136878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab691-7606-446b-b987-9ad6612aa940 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.137167 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab691-7606-446b-b987-9ad6612aa940 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.137448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eab691-7606-446b-b987-9ad6612aa940 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.138851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/324] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:49.144302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.144589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.144898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.146442 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.155763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb3a9f-d1a4-42f7-8162-17e878f24c8e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.162085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:49.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:49.191480 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.192174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.192463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.192783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] PATH_INFO: `/v3/groups` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.193474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.194907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.231262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/325] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:49.232084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.258120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.275783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 164/326] 10.222.0.10 () {60 vars in 1134 bytes} [Fri Jun 10 12:44:49 2022] POST /identity/v3/groups => generated 226 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:44:49.276608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.338638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fefb2-2e88-4084-82b0-694002b2426f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.379149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.380050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.380430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.380805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.389816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9a450-aa6d-4a6c-98a6-646b1574f3f1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.394025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:49.401942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:49.403711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:49.404532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/327] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:49.409848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.434799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.435613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.435897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.436177 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.448257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:49.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:49.457017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:49.457812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 165/328] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:49.463704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.479665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.515560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.532329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa3cbb-1dad-4a08-84a5-4f517c8b4cd9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.575967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.577027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.577520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.577926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.578834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:49.579302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.580866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.591438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a77d7-5221-49b1-a998-b1702eeab8a5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.592161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/329] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:49.597725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.639255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.639952 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.640236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.640510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.641294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:49.641607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.642997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.653433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 166/330] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:49.658834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.745220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ceb73-1cf8-42ed-8dc4-60cebbbf7246 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.759375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.795054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.796185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.796612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.797015 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d15b93-b441-45bd-8557-f363f2a20700 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.797238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] PATH_INFO: `/v3/users/d2e177e7457743108268f0b0d1213165` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.798622 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] RBAC: Authorizing `identity:get_user(user_id=d2e177e7457743108268f0b0d1213165)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.800212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.802792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/331] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/users/d2e177e7457743108268f0b0d1213165 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:49.809353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.834050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:49.836235 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:49.837144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:49.837433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:49.837714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] PATH_INFO: `/v3/users/d5ca074ea9f04027af5b87ca22942fc6` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:49.838929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] RBAC: Authorizing `identity:get_user(user_id=d5ca074ea9f04027af5b87ca22942fc6)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:49.842181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:49.843465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 167/332] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/users/d5ca074ea9f04027af5b87ca22942fc6 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:49.848941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:49.957926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c613696-fbdf-49b7-af0e-d6eac3f17799 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:49.994647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e157be-f76f-4e9c-90e7-d26d80b44239 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:50.005875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:50.006532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:50.006812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:50.007084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:50.007913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] RBAC: Adding query filter params (role.id=fd48ed2e35674327b4449b3be67d32c4, user.id=d2e177e7457743108268f0b0d1213165, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:50.008253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:50.009744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fbb54-c6f0-4e02-a4e0-d22b9b5e0e11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:50.028742 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/333] 10.222.0.10 () {56 vars in 1308 bytes} [Fri Jun 10 12:44:49 2022] GET /identity/v3/role_assignments?user.id=d2e177e7457743108268f0b0d1213165&scope.system=all&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:50.038853 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:50.039748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:50.040030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:50.040307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] PATH_INFO: `/v3/system/users/d5ca074ea9f04027af5b87ca22942fc6/roles/877094ee517d4ff782d2119eae963315` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:50.041967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5ca074ea9f04027af5b87ca22942fc6, role_id=877094ee517d4ff782d2119eae963315)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:50.044317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77f8bd-852f-4906-9e24-4e13229853bf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:50.123961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 168/334] 10.222.0.10 () {58 vars in 1334 bytes} [Fri Jun 10 12:44:49 2022] PUT /identity/v3/system/users/d5ca074ea9f04027af5b87ca22942fc6/roles/877094ee517d4ff782d2119eae963315 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:44:51.685299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d33b-2a91-4c07-ba27-71a0dcf3e4bd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:51.685865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d33b-2a91-4c07-ba27-71a0dcf3e4bd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:51.685865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967d33b-2a91-4c07-ba27-71a0dcf3e4bd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:51.687341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/335] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:51.692895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:51.693327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:51.693518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:51.705539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:51.712306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:51.717970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:51.801889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 169/336] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:51.849830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d33b-2a91-4c07-ba27-71a0dcf3e4bd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:51.949132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:51.974620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967d33b-2a91-4c07-ba27-71a0dcf3e4bd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:52.022519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:52.023318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.023614 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.023888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.037578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dcca3dcb-cede-4101-8596-22fea4eaa8c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:52.046460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:52.047365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:52.048194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:52.051728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/337] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:52.053321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:52.065335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c385c-4cf0-4bfd-84b6-5240fb3581ec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.065623 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c385c-4cf0-4bfd-84b6-5240fb3581ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.065888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c385c-4cf0-4bfd-84b6-5240fb3581ec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.071574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/338] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:52.072668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.072959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.073235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.115922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:52.119041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:52.230902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/339] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:52.236104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32cda6-6b9c-4b14-b754-33f589551b3c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:52.275806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:52.276810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:52.278225 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.278728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.279315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.280341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:52.281791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:52.283402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:52.286203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:52.298165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 170/340] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:52.309163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:52.419212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:52.494500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0494e38-4196-4a80-9f65-b1d1c4601f38 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:52.516109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c61756-bffd-46df-9638-dfd622269e6f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:52.567007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:52.567668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.567953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.568228 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.596043 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:52.596887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.597171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.597440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.613570 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:52.626733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:52.627647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:52.628445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/341] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:52.633798 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:52.766220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73982f5-6838-4136-bcf5-de14c98945ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:52.793109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:52.793634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:52.803089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:52.805029 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:52.817537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:52.818289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:52.818572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:52.818846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:52.819614 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:52.819921 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:52.821333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:52.834911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/342] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:52.858162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:52.962907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 171/343] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:52.968507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.017762 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8099f-24e6-4b2f-b80e-c260edf6e12b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.085356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.086023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.086306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.086578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.109949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cae068-29cb-4326-b007-85f86992a1fa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.112918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.161331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.162204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.162488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.162765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.163974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.165440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.167418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 172/344] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:53.169378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.173078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.191607 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.193425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.319553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b7d4b-46b9-4ac6-b96b-e879007577a4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.369425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813827f4-7472-439d-a234-52281f6baecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.370298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813827f4-7472-439d-a234-52281f6baecc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.371085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813827f4-7472-439d-a234-52281f6baecc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.371370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813827f4-7472-439d-a234-52281f6baecc None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.381260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813827f4-7472-439d-a234-52281f6baecc None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.382696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813827f4-7472-439d-a234-52281f6baecc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.384359 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 173/345] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:53 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:53.390422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813827f4-7472-439d-a234-52281f6baecc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.407415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/346] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:53.413303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.439482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.533279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813827f4-7472-439d-a234-52281f6baecc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.587072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.601569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3016-9d50-49c8-b216-2c6de9acc9e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.614958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.615636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.615921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.616201 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.617290 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=166024519ec34edda30537bd1594ab2c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:53.617649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.619101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5da495-4f01-439f-8180-6d1810f25cc9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.634450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 174/347] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:44:53 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:53.635770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631d5c-ef2d-40e7-ae02-e8fd6063e742 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.636798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631d5c-ef2d-40e7-ae02-e8fd6063e742 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.637241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22631d5c-ef2d-40e7-ae02-e8fd6063e742 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.638991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 175/348] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:53.645052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c962-51be-4cd3-9661-88426ec07f06 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.645743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c962-51be-4cd3-9661-88426ec07f06 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.646171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135c962-51be-4cd3-9661-88426ec07f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.651322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.652799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.653298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.653772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.658780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.661339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.669195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/349] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:53 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:53.675206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.682361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c135c962-51be-4cd3-9661-88426ec07f06 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:53.683643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c135c962-51be-4cd3-9661-88426ec07f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:53.820409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a96cdb-1590-4b4a-a99f-43f168e20ede None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:53.861099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:53.862014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.862292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.862592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.862928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 176/350] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:44:53.864100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:53.864361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1db739-e9c8-429e-815a-3008b89581a5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.864668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1db739-e9c8-429e-815a-3008b89581a5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.864951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1db739-e9c8-429e-815a-3008b89581a5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.865892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:53.866394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 177/351] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:53.867962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/352] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:53 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:53.871951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532e1e-7890-4414-8b7e-a6e85eb6558b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:53.872231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532e1e-7890-4414-8b7e-a6e85eb6558b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:53.872505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532e1e-7890-4414-8b7e-a6e85eb6558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:53.873537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:53.901762 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-78532e1e-7890-4414-8b7e-a6e85eb6558b None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:53.903761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-78532e1e-7890-4414-8b7e-a6e85eb6558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:53.909044 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.928021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:53.990841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a1702-52d6-4b78-81c8-b85e605c39c5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.009357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 178/353] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:54.016943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe620-abdf-4fd4-9440-164bdbb312e4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.017277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe620-abdf-4fd4-9440-164bdbb312e4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.017584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe620-abdf-4fd4-9440-164bdbb312e4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.019341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 179/354] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:54.020098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe620-abdf-4fd4-9440-164bdbb312e4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.041368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.042067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.042352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.042716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.043575 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=166024519ec34edda30537bd1594ab2c) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:54.043883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:54.045621 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3617-0a2c-4927-ae58-decce5e6bf3f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:54.052276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/355] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:44:53 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=e253d3f882df44caa26394cdc954b92a => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:54.053624 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.053909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.054182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.076916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:54.078117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:54.150128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe620-abdf-4fd4-9440-164bdbb312e4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.177469 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/356] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:54.178451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.191769 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.192647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.192967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.193245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.205950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.206247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:54.214685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:54.218541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:54.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 180/357] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:54.222209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.244993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.340213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b35fd-8a5e-4863-8844-ffeb878ae456 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.388873 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.389549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.389799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e0955-0c73-41ce-8db2-ad294b12913b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.389918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.390083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.390845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:54.391155 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:54.392860 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:54.405197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 181/358] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:54.406102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.431310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.432729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.433404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.433977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.445590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:54.454970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:54.455889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:54.456687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:54.459361 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/359] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:54.460442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.516317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.548269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2276c-4475-42fe-b46d-de76b4bd157a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.591329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.592699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.593122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.594573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.606661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.612233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:54.621361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:54.625824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 182/360] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:54.626644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.670238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb87094-a9b8-42f0-8b2e-db6409508341 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.713560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.715127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.715477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.716030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] PATH_INFO: `/v3/users/d5ca074ea9f04027af5b87ca22942fc6` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.717563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] RBAC: Authorizing `identity:get_user(user_id=d5ca074ea9f04027af5b87ca22942fc6)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:54.719984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:54.721740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/361] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/users/d5ca074ea9f04027af5b87ca22942fc6 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:54.722630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.752566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf69b-3d70-4abf-adf5-b6c921fbe85b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.789852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.790621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.790909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.791287 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.792050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:54.792357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:54.793834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3546b-e3e0-4f90-b980-ba64be44515c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:54.796782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.804204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 183/362] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:54.814882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb071c-243a-41d1-b639-c0e460e48d98 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.814882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb071c-243a-41d1-b639-c0e460e48d98 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.814882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb071c-243a-41d1-b639-c0e460e48d98 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.814882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 184/363] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:54.814882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb071c-243a-41d1-b639-c0e460e48d98 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.852157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80167705-7a39-4be0-a8a0-5323dbb156e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.895031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.895714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.896257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.896547 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.897325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:54.897786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:54.899928 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:54.911121 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/364] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:54.912026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:54.922634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:54.949590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb071c-243a-41d1-b639-c0e460e48d98 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:54.997155 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:54.997862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:54.998144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:54.998420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:54.999258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] RBAC: Adding query filter params (role.id=877094ee517d4ff782d2119eae963315, user.id=d5ca074ea9f04027af5b87ca22942fc6, scope.system=all) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:54.999568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.001087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579c5c-3b44-42eb-9e44-2be4a6833a93 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.019285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 185/365] 10.222.0.10 () {56 vars in 1308 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/role_assignments?user.id=d5ca074ea9f04027af5b87ca22942fc6&scope.system=all&role.id=877094ee517d4ff782d2119eae963315 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:55.021461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.021754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.022032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.041725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcfd81-f8f5-4fb3-b17a-75b60e7f1ed3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.044688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:55.046159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:55.093990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.094661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.094941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.095210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.109409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.128758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 186/366] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:55.129699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.220703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.222151 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.241027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.273614 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66084f-c344-47bb-97a7-39ff1b0afb1a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.315346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.316360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.316879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.317377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.364694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/367] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:55.365555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.387615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.402918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.404708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.509082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ba-9dc4-4968-adf1-7f9cd6cb202f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.519957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.533922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 187/368] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:55.535084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.556403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.557672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.558766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.559331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.577671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:55.585448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:55.586350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:55.587127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/369] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:55.587799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.673940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.693239 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a85d-1533-43f3-a84f-de7f9c0285e2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.721386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f04b08-b98d-457f-9ebb-22a3151dd47e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.737703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.738956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.739514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.739946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.741791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.743407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.746250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 188/370] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:55.747330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.767349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.768680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.769995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.770501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.771918 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.773710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.775801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/371] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:55.777018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.817309 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:55.880131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6fe7-9c2d-40e3-ae7b-7b76e6ec6cf4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.895903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e18f0e-3da4-4b1d-9e6f-f1b74dc1d6fe None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:55.923240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.924181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.924473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.924783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.925535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:55.925848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.927840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.938903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:55.939103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 189/372] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:55.939737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.940378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:55.940917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:55.941390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:55.946844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:55.948546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:55.951386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/373] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:55.951764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:55.970000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.081088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126432-9a4e-4139-8c37-cc7d0591e84a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.082124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1695e2-9a9e-4bec-a98a-21d2d7ccf879 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.082588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.121847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.122728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.122887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.123328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.123745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.123942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.124315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.124743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.126007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.127621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.129412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 190/374] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:56.130271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.200699 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.202511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.237309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.259415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac07f-7dec-4bd0-be51-ee6d832254d0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.311777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.313271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.313733 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.314411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.315662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=17ad6fd92442448db5154fbd88412cea) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:56.316147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.318765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.328838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/376] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:44:56.328838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.329171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 191/376] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=e253d3f882df44caa26394cdc954b92a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:56.333647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.335080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.515381 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7724-d182-43fe-8c71-04950efa9422 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.519880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b12eba-dbb3-43e9-b37e-6d0f0eee226f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.572699 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.573394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.574488 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.574837 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.575564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.575748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=17ad6fd92442448db5154fbd88412cea) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:56.576071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.576916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.577371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.577637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be4f2f-74b9-4832-a150-63161a8204ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.577946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] PATH_INFO: `/v3/projects/cacd4613b1334c5abdaa9f563eb09cde` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.579294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] RBAC: Authorizing `identity:get_project(project_id=cacd4613b1334c5abdaa9f563eb09cde)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.581793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.584859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/377] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:56.585334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 192/378] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/projects/cacd4613b1334c5abdaa9f563eb09cde => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:56.590157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb438-fafc-4d47-be4d-b99984557404 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.590695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb438-fafc-4d47-be4d-b99984557404 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.591130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aadb438-fafc-4d47-be4d-b99984557404 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.593902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.597507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/379] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:56.599861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b71db-b668-46c9-9a65-03962c4ab61a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.611051 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b71db-b668-46c9-9a65-03962c4ab61a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.611569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b71db-b668-46c9-9a65-03962c4ab61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.642307 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.652819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b00b71db-b668-46c9-9a65-03962c4ab61a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:56.654142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b00b71db-b668-46c9-9a65-03962c4ab61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:56.778201 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9d0b0-6609-4b5f-bf96-ba78ad70ac3e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.806738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.815143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/380] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:56.828997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.829942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.830333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.830713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] PATH_INFO: `/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.832350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce7c6-31cb-4489-84b8-3873c669a332 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.832673 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce7c6-31cb-4489-84b8-3873c669a332 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.832960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ce7c6-31cb-4489-84b8-3873c669a332 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.835834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/381] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:56.836322 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] RBAC: Authorizing `identity:get_group(group_id=7fc62ecc62d34aa1be6d77a3d8f5e2c5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.837839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:56.839966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 193/382] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:56.840803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.841114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.842504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.845338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.860755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:56.861947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:56.932536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:56.940751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/383] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:56.941704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:56.954065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa725-4445-410f-8b7a-3c151fd243fc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:56.991760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:56.992501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:56.993729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:56.993729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:56.994077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] RBAC: Adding query filter params (group.id=7fc62ecc62d34aa1be6d77a3d8f5e2c5, role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=cacd4613b1334c5abdaa9f563eb09cde) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:56.994302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:56.996282 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.003937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 194/384] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/role_assignments?group.id=7fc62ecc62d34aa1be6d77a3d8f5e2c5&scope.project.id=cacd4613b1334c5abdaa9f563eb09cde&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:57.012651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.146977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a590d-893b-4278-831c-aea3b0d67694 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.187559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1398e15-4d64-491a-bdbe-fa0cd5fa2b91 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.202479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:57.229795 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.231332 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.232139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.232419 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.232717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.233553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.233826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.234091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.257000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:57.266052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:57.268158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:57.270129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 195/385] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:57.271720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:57.276930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:57.279393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:57.281463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/386] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:57.283063 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.284694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.292006 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:57.455409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0278b-e55a-468b-9450-00404bf2666d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.499315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.499983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.500262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.500534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.501313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:57.501615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:57.503186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.514305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 196/387] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:57.521600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.554782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a7ff-313a-4d17-ad28-330b1633b7c2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.597255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:57.634706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.635716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.636006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.636409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.641475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:57.641797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:57.643187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.646488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b87e-f946-4d66-896d-b50267c1367e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.662846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/388] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:57.671970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.737467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.738255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.738536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.738797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.742403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:57.743848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.746042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 197/389] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:57.750921 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:57.752920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.868402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c0dc0-cbf7-4078-bb51-783c565d732a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.919406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.920304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e57025-e3e2-41e0-9c9f-34a9ecd0999e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:57.920537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.920999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.921285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.922835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:57.924324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.933018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/390] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:57.934553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:57.985437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:57.986577 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:57.987012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:57.987439 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:57.988955 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:57.990547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:57.992723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 198/391] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:58.018076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:58.027802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:58.060029 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bf7b2-d0d1-47fa-a2e6-e367af5fc950 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:58.080099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:58.100002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:58.101204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:58.101637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:58.102062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:58.103732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:58.105895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:58.109434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/392] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:44:57 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:58.114225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:58.176502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144ae03-30eb-466e-ac31-858ce4880144 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:58.223353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:58.224147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:58.224427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:58.224893 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:58.227007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, group_id=27d0ec87f02a4ded8c4d4f718e04cd29, role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:58.228174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f489e2b-e191-4229-908d-d6a68ef7ec6a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:58.228443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a8f90c-b5a4-4d79-8f58-9aa65868212e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:58.269885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:58.271376 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:58.271833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:58.272259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:58.274506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=166024519ec34edda30537bd1594ab2c, group_id=27d0ec87f02a4ded8c4d4f718e04cd29, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:58.276089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68c620-3d40-453e-b0ad-dd53c0f98cd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:58.334540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 199/393] 10.222.0.10 () {58 vars in 1442 bytes} [Fri Jun 10 12:44:58 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/e253d3f882df44caa26394cdc954b92a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:44:58.357884 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/394] 10.222.0.10 () {58 vars in 1442 bytes} [Fri Jun 10 12:44:58 2022] PUT /identity/v3/projects/166024519ec34edda30537bd1594ab2c/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:44:59.125215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78318ad-933b-49c0-8c3f-9eea08154f45 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.125723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78318ad-933b-49c0-8c3f-9eea08154f45 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.125799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78318ad-933b-49c0-8c3f-9eea08154f45 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.127435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 200/395] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:59.132841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72cec-a346-4c97-8297-ebccd00e472c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.133273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72cec-a346-4c97-8297-ebccd00e472c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.133479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec72cec-a346-4c97-8297-ebccd00e472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.153030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5ec72cec-a346-4c97-8297-ebccd00e472c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:59.154669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5ec72cec-a346-4c97-8297-ebccd00e472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:59.205974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:59.241925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/396] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:59.253209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f0f5-e2c8-4863-ad3f-44ed6e7422a6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.253495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f0f5-e2c8-4863-ad3f-44ed6e7422a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.253780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9f0f5-e2c8-4863-ad3f-44ed6e7422a6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.255181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 201/397] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:59.260698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.260994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.261382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.279428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:59.282059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9f0f5-e2c8-4863-ad3f-44ed6e7422a6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.282414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:59.369001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/398] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:59.379708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:59.393376 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.434825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9f0f5-e2c8-4863-ad3f-44ed6e7422a6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.478422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:59.479506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.480653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.481106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.494899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:59.504989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:59.506125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:44:59.506941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:44:59.510434 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 202/399] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:44:59.518119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.537975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d4fc-8a48-4e32-8428-81b0bb0e6dad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.544260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:59.592756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:59.594741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.595236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.595713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.617307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9baf63f2-47a8-4701-b335-fdb7a9e65cd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:44:59.628365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:44:59.629387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:44:59.630232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/400] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:44:59.631792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a792-2975-410c-80fd-991a2b059c22 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.632081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a792-2975-410c-80fd-991a2b059c22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.632359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a792-2975-410c-80fd-991a2b059c22 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.634329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/401] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:44:59.636779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a792-2975-410c-80fd-991a2b059c22 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.687725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523980a-78ab-4bac-b269-9be5953d2d9e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.713964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:59.727145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:59.727898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.728188 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.728463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.740150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:59.740150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:59.740150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba033e17-aa40-4580-b75e-4ea185ae00ac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:59.742008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 203/402] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:59.743508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.744029 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.744497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.759457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a792-2975-410c-80fd-991a2b059c22 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.763825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:44:59.765070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:44:59.798719 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:59.799752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.800276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.800780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.801800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:44:59.802401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:59.804275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:59.814611 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/403] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:44:59.815886 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.842185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 204/404] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:44:59.843177 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.849885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:44:59.927740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaff0a-58ce-48cd-9430-3e1403072666 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.968924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:44:59.970122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:44:59.970608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:44:59.971089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:44:59.972540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:44:59.974307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:44:59.976553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/405] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:44:59.977314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893adcfa-e9df-4ed1-8ac1-9f32e1ce368e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:44:59.977936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:44:59.993337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.017503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.018791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.019292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.019808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.021353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.023115 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.025343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 205/406] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.026383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.091504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.098365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96675b0-e39f-4bf2-9dd8-f4509c634c0a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.136284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.137587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.137879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.138228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.139883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb774e-87ac-4ead-9e01-25a9f849ed4f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.149341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:00.158241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:00.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:00.160024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:00.164317 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/407] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:00.165218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.182211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.184202 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.184786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.185261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.186882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.188677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.191146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 206/408] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:00 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.192295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.249184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.279763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b83b79-d4f8-4595-b49a-73eee71024fb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.309544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e08c1-8ee4-4b5c-8705-2088d71132f9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.324177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.325519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.326024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.326498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.327979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.329716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.331923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/409] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:00 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.332947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.353874 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.354549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.355358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.355651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.356408 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:00.356756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.358126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.362802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.370870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 207/410] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.372890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.448258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b39ce-6eea-46be-9024-8c019bd01c1e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.486308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.487531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.488017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.488489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.490690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, group_id=27d0ec87f02a4ded8c4d4f718e04cd29, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.492360 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.506813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a974a9a-046d-4ca7-b3ef-5fb18c08afc1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.520888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.541757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.542718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.543005 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.543284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.545900 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] RBAC: Authorizing `identity:create_grant(project_id=17ad6fd92442448db5154fbd88412cea, group_id=27d0ec87f02a4ded8c4d4f718e04cd29, role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.547358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.567778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/411] 10.222.0.10 () {58 vars in 1442 bytes} [Fri Jun 10 12:45:00 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:00.569030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.631385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 208/412] 10.222.0.10 () {58 vars in 1442 bytes} [Fri Jun 10 12:45:00 2022] PUT /identity/v3/projects/17ad6fd92442448db5154fbd88412cea/groups/27d0ec87f02a4ded8c4d4f718e04cd29/roles/e253d3f882df44caa26394cdc954b92a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:00.675272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:00.697744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7b24-f34a-424d-9080-24a370ba55b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.739316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.740300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.740716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.741056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] PATH_INFO: `/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.747418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] RBAC: Authorizing `identity:get_group(group_id=7fc62ecc62d34aa1be6d77a3d8f5e2c5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.747418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.752228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/413] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:00 2022] GET /identity/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.760432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:00.896663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d308-fcab-4bc6-9732-0d452630c861 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:00.934260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:00.935294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:00.935674 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:00.936047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] PATH_INFO: `/v3/projects/cacd4613b1334c5abdaa9f563eb09cde` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:00.937395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] RBAC: Authorizing `identity:get_project(project_id=cacd4613b1334c5abdaa9f563eb09cde)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:00.938940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa5ac0-f3e2-4ee0-8f1f-79fd7eb54a83 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:00.941039 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 209/414] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:00 2022] GET /identity/v3/projects/cacd4613b1334c5abdaa9f563eb09cde => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:00.946790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:01.065660 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc13db9-1b26-490f-9944-4731c13fb04a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:01.079370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742efca7-c64c-4a7c-8afc-03e136c046b9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.079799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742efca7-c64c-4a7c-8afc-03e136c046b9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.080179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742efca7-c64c-4a7c-8afc-03e136c046b9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.082507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 210/415] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:01.090122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.090581 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.090969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.121738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:01.123913 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:01.131127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:01.132203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.132653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.133104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] PATH_INFO: `/v3/projects/cacd4613b1334c5abdaa9f563eb09cde/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.135285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=cacd4613b1334c5abdaa9f563eb09cde, group_id=7fc62ecc62d34aa1be6d77a3d8f5e2c5, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:01.142225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:01.177673 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:01.212087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/416] 10.222.0.10 () {58 vars in 1442 bytes} [Fri Jun 10 12:45:00 2022] PUT /identity/v3/projects/cacd4613b1334c5abdaa9f563eb09cde/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:01.223645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 211/417] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:01.251394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:01.266227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:01.384077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41c8c6-a9ce-42e5-9ce1-446e380f75a3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:01.434529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:01.435702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.436134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.436551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.456041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e42d356d-2642-4e5d-855b-67cd8ae68b3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:01.465592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:01.466749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:01.467741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:01.470214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/418] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:01.476256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:01.491989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94365d5-30bb-4a7c-ad5b-8e3bb38af849 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.492508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94365d5-30bb-4a7c-ad5b-8e3bb38af849 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.492995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94365d5-30bb-4a7c-ad5b-8e3bb38af849 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.497053 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/419] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:01.501720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.502245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.502659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.530832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:01.533205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:01.646738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035bcd9-300f-412b-9e9a-387a9ce29490 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:01.648709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:01.657049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/420] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:01.692325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:01.693725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:01.694622 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.695275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.695691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.696567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:01.697168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:01.699744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:01.709767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 212/421] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:01.716784 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:01.751433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:01.832495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae90faf-82db-47e5-aeb2-13018d2f6bb0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:01.871808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:01.872707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:01.873129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:01.873841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:01.952012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:01.953711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:01.987524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a7b0a-57ee-489b-a69f-2caf59ea5df2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:01.990584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:02.069533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 213/422] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 10 12:45:02.076093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:02.109354 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.110169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.110451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.110724 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.169287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:02.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:02.178345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:45:02.179343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:02.185062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/423] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 493 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:02.187729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ab653-02af-43f3-9385-77e39820c4de None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:02.191247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:02.221181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:02.226531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.227669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.228135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.228547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.231980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:02.232573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:02.234824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 214/424] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:02 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:02.240650 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:02.349815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3331371-ed27-4b0a-adac-916d845ead39 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:02.386456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.387643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.388068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.388501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.390001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:02.391579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:02.393397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 215/425] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:02 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:02.399536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:02.418642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:02.497111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:02.509165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af20868-7ea8-4a49-bd0c-f4474b4ac83c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:02.547987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.549099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.549558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.550001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.551021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=166024519ec34edda30537bd1594ab2c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:02.551506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:02.553137 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:02.561174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 216/426] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:45:02 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=e253d3f882df44caa26394cdc954b92a => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:02.587858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c062d7f-cb8f-4062-8e96-a6a28e6c1ccb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:02.665347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.666039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.666327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.666606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.667963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:02.668275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:02.669986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:02.686055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/427] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:45:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:02.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:02.844720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849d3b3-e345-45b9-a6d9-1a5b91e4cfb7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:02.875831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:02.884018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:02.884689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:02.889850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:02.889850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:02.975663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:02.977430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b21ee-9b95-4e94-a0a4-f28fa78c6d78 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.090070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 217/428] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:03.095725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.205946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392c87c-ff5a-45b5-8b6c-ffca96951b89 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.235494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29993a-7c06-4649-b853-942d48356bf0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.236003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29993a-7c06-4649-b853-942d48356bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.236077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29993a-7c06-4649-b853-942d48356bf0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.237025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.237780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 218/429] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:03.243298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a629-4e4f-4962-aa1e-6f08dd2925d8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.243873 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a629-4e4f-4962-aa1e-6f08dd2925d8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.244264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a56a629-4e4f-4962-aa1e-6f08dd2925d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.244557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.245470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.245806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.246121 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] PATH_INFO: `/v3/projects/166024519ec34edda30537bd1594ab2c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.247312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] RBAC: Authorizing `identity:get_project(project_id=166024519ec34edda30537bd1594ab2c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:03.248798 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae236b50-9538-41a8-81c5-b41b95de8ebd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.250470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/430] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/projects/166024519ec34edda30537bd1594ab2c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:03.251643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d3d8-9fb9-4ea7-8433-426e90ef2bf1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.251903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d3d8-9fb9-4ea7-8433-426e90ef2bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.252176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d3d8-9fb9-4ea7-8433-426e90ef2bf1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.257661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/431] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:03.258405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d3d8-9fb9-4ea7-8433-426e90ef2bf1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.263463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9a56a629-4e4f-4962-aa1e-6f08dd2925d8 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:03.267422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9a56a629-4e4f-4962-aa1e-6f08dd2925d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:03.296669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.340457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 219/432] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:03.344891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.344891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.344891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.362759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:03.364099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:03.380876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d3d8-9fb9-4ea7-8433-426e90ef2bf1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.415917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.416812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.417095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.417511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.418804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:03.420493 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.422115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/433] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:03.422863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.439089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 220/434] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:03.449221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.484262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.531254 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e578e-7273-47a8-b645-b44c7c067c2c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.547398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.556302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee246b-09e7-40e3-a158-bdbd425ab240 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.568905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.569700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.569989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.570266 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.581219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:03.589259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:03.590810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 10 12:45:03.591594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:03.592197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/435] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:03.592822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.597830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.598490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.598770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.599040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.599900 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=166024519ec34edda30537bd1594ab2c) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:03.600213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:03.601670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.614418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 221/436] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=166024519ec34edda30537bd1594ab2c&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:03.614418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.733891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f38c5-eedc-46e9-b571-fe14e38d084e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.741999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3101b-f0d2-4f02-a1b5-70524bdd6bdc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.752772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.772049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.772897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.773182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.773455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.783726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.784682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.785950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.785950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.786109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:03.786448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:03.786924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:03.788454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ad211-5d02-43c1-8dd7-84f3a8bf10b1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2cc161c7-1347-4a43-9850-5ba03fc16ef8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:03.794103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:03.795280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:03.796080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/437] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:03.797693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e430-7c96-46d4-909f-befa816f6e73 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.797693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e430-7c96-46d4-909f-befa816f6e73 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.797693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0e430-7c96-46d4-909f-befa816f6e73 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.799453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/438] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:03.802216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0e430-7c96-46d4-909f-befa816f6e73 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.802644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 222/439] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:03.805666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.806068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.806363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.832043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:03.833728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:03.847998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:03.916523 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 223/440] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:03.917352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:03.919462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0e430-7c96-46d4-909f-befa816f6e73 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:03.966733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:03.967468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:03.967756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:03.968034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:03.968820 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:03.969129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:03.970518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:03.979660 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/441] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:03.981208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.033504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.040802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bdcdf-e104-406b-8f8a-f6a87cc9e6c1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.082249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.083481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.083657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.103201 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.106687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3503a-cea9-4cb4-8df3-1e99e64907a7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.151950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.152935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.153216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.153488 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.161135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.162663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.165828 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:04.174305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:04.175192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:04.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/442] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:04.177165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.266233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 224/443] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:04.269573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.277255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.280449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62219163-c00a-46ec-ba16-8502761d9872 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.313547 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.314226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.314502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.314776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.316318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.366818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d925dc5-cdc7-4b56-8c5d-585aa456ff72 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.383202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.384692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.399687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.400374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.400687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.400972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.402360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:04.402679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.404040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.412130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 225/444] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.412959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.479050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.482412 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/445] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:04.483224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.512707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8757e2e-a8b5-4b4b-ba99-d5ccc9cdfdb5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.522642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.546220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.547069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.547350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.547624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.548830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.550264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.551919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 226/446] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.552696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.582220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479df41-4cb4-4201-a46a-cd215ebf0d5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.616437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.616779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.617064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.617343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.656002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a04d-c422-4c4d-a706-07e817e1bc85 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.687346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.689404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.691026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.691677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.691884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.692173 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.692449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] PATH_INFO: `/v3/projects/17ad6fd92442448db5154fbd88412cea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.693662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=17ad6fd92442448db5154fbd88412cea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.695186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.696921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 227/447] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/projects/17ad6fd92442448db5154fbd88412cea => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.697685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.746129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.790646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/448] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:04.791487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.802362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ffe2b-cc77-4973-9c56-ca3a19822cb3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.835375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.836216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.836499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.836808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.838270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.839624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.841509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 228/449] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.842273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.888892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.891688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72656aa4-f172-417b-8b9a-16da763f5ae8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.925366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.926220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.926511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.926785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] PATH_INFO: `/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.927959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] RBAC: Authorizing `identity:get_group(group_id=27d0ec87f02a4ded8c4d4f718e04cd29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.929448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.931062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/450] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/groups/27d0ec87f02a4ded8c4d4f718e04cd29 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.931818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:04.945068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b0d4f-5a11-4114-a58c-4f62be752825 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:04.959368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:04.979555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:04.980629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:04.980905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:04.981186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] PATH_INFO: `/v3/projects/cacd4613b1334c5abdaa9f563eb09cde` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:04.982357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] RBAC: Authorizing `identity:get_project(project_id=cacd4613b1334c5abdaa9f563eb09cde)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:04.983878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:04.989993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 229/451] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/projects/cacd4613b1334c5abdaa9f563eb09cde => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:04.989993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:05.030749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562638cc-651d-4e4d-a3d7-0cdf9119366e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:05.063328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:05.063967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:05.064243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:05.064519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:05.065368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=fd48ed2e35674327b4449b3be67d32c4, scope.project.id=17ad6fd92442448db5154fbd88412cea) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:05.065672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:05.067108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:05.074566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/452] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=fd48ed2e35674327b4449b3be67d32c4 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:05.075650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:05.087822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5bad1e-2e43-4cdf-a414-96e57e77285c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:05.114135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:05.127253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:05.127929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:05.128385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:05.128704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:05.130044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] RBAC: Adding query filter params (group.id=27d0ec87f02a4ded8c4d4f718e04cd29, role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=17ad6fd92442448db5154fbd88412cea) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:05.130666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:05.132355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:05.140922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 230/453] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:45:04 2022] GET /identity/v3/role_assignments?group.id=27d0ec87f02a4ded8c4d4f718e04cd29&scope.project.id=17ad6fd92442448db5154fbd88412cea&role.id=e253d3f882df44caa26394cdc954b92a => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:05.194449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560b3db-b13f-47bc-b70f-a1a7e20c1869 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:05.234257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:05.235153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:05.235438 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:05.235745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] PATH_INFO: `/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:05.237138 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] RBAC: Authorizing `identity:get_group(group_id=7fc62ecc62d34aa1be6d77a3d8f5e2c5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:05.238663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61aa8e-bc44-4802-8a34-10c3b4e6d88e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:05.240657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/454] 10.222.0.10 () {56 vars in 1180 bytes} [Fri Jun 10 12:45:05 2022] GET /identity/v3/groups/7fc62ecc62d34aa1be6d77a3d8f5e2c5 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:05.247190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:05.306435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:05.365200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bc535-3cd6-4d22-a8f8-5eb9fd6520cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:05.403463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:05.404123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:05.404466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:05.404787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:05.405616 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] RBAC: Adding query filter params (group.id=7fc62ecc62d34aa1be6d77a3d8f5e2c5, role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=cacd4613b1334c5abdaa9f563eb09cde) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:05.405933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:05.407382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab6a14-9cdf-44f7-96c4-dc88afb3d8f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:05.413269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 231/455] 10.222.0.10 () {56 vars in 1376 bytes} [Fri Jun 10 12:45:05 2022] GET /identity/v3/role_assignments?group.id=7fc62ecc62d34aa1be6d77a3d8f5e2c5&scope.project.id=cacd4613b1334c5abdaa9f563eb09cde&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:08.124882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de111-9552-47bc-8817-0a8a46db966d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.125744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de111-9552-47bc-8817-0a8a46db966d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.126196 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6de111-9552-47bc-8817-0a8a46db966d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.127713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/456] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:08.133029 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db60b37-5038-4c94-a93c-c734f895b538 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.133782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db60b37-5038-4c94-a93c-c734f895b538 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.134210 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db60b37-5038-4c94-a93c-c734f895b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.161596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1db60b37-5038-4c94-a93c-c734f895b538 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:08.163033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1db60b37-5038-4c94-a93c-c734f895b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:08.247479 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 232/457] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:08.290193 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de111-9552-47bc-8817-0a8a46db966d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:08.314284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade986-7869-4e35-8361-1a700c3eaae2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.314833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade986-7869-4e35-8361-1a700c3eaae2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.315259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade986-7869-4e35-8361-1a700c3eaae2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.316827 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 233/458] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:08.330067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6dbc-660d-49ca-85cd-28d84c3b1f54 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.330560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6dbc-660d-49ca-85cd-28d84c3b1f54 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.331003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d6dbc-660d-49ca-85cd-28d84c3b1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.369845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3a5d6dbc-660d-49ca-85cd-28d84c3b1f54 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:08.372206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3a5d6dbc-660d-49ca-85cd-28d84c3b1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:08.408203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:08.413746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6de111-9552-47bc-8817-0a8a46db966d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:08.452410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:08.463720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:08.464562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.464876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.465148 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.491474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:08.493439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:08.514625 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 234/459] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 10 12:45:08.516197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971235-6be2-4f2f-bc60-8930061cac7d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.516686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971235-6be2-4f2f-bc60-8930061cac7d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.517111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75971235-6be2-4f2f-bc60-8930061cac7d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.518747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 235/460] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:08.521061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:08.522108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:08.523103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:08.523103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:08.523103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.523103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:08.523892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.524186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.524469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.525279 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/461] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:08.531374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:08.544500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:08.545985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:08.622283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 236/462] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:08.623382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:08.680126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f86daa-4953-42e4-b88e-843e38c64d9e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:08.717849 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:08.719008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.719292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.719713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.720543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:08.721135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:08.723198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c589269-141c-46ae-bc25-ca8d01e728f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:08.730518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:08.733993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e80784-4d4e-482b-9bcc-f8bb6a8020d3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/463] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa16-8e86-4c1f-b350-555165644dc9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa16-8e86-4c1f-b350-555165644dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4fa16-8e86-4c1f-b350-555165644dc9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/464] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:08.745727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4fa16-8e86-4c1f-b350-555165644dc9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:08.767728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:08.779176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:08.780032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.780324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.780604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.791526 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:08.793009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:08.816204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:08.817154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:08.817983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:08.817983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:08.817983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.817983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:08.818657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 237/465] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:08.819087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:08.859246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4fa16-8e86-4c1f-b350-555165644dc9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:08.893935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:08.894720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.895002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.895276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.906223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:08.907679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:08.923317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78e46-388a-4f7b-90c5-0498b10c27e5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3f6411e7-45b2-4a89-adc6-8c5d13a58d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:08.925907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:08.926747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:08.927861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:08.927861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:08.927861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:08.927861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:08.927861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/466] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:08.928299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.928530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.928824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.948919 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:08.950213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:08.961178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:08.961846 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:08.962125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:08.962392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:08.963090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:08.965096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.008791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.016796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/467] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:09.017861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.053545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 238/468] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:08 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:09.054085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.071180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.139286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd1e12-ff70-4a20-b1e3-a73dc7a6e891 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.189478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.190651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.191565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.192547 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.193831 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:09.194339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.195058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9391c-8d89-4ac6-b20b-d37da5852f7a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.196074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.214585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/469] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:09.215745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.239633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.240295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.240603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.240959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.241681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:09.242149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.244490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.258039 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 239/470] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:09.258471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.287943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.348942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.350965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949bfc-ea60-4282-a142-24613876f1bc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.390307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.391563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.392042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.392524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.394044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d0ab3-5e7c-4070-9e7d-9fd09c387e9d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.404557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.406365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:09.424423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:09.425356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:09.426180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:09.426180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:09.426180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:09.426180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:09.426180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/471] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:09.426687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.437438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.438121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.438402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.438680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.439395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.440879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2600ae-e1fb-49df-a725-9ba0e17fd88d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.511450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 240/472] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:09 2022] POST /identity/v3/users => generated 248 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:09.513098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826580d-4f49-4987-b821-ae5f7677da5f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.513591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826580d-4f49-4987-b821-ae5f7677da5f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.514083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826580d-4f49-4987-b821-ae5f7677da5f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.515641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 241/473] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:09.516664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826580d-4f49-4987-b821-ae5f7677da5f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.534809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7ed1d-a1e8-4f3e-8619-cf48b914c2e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.542844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.583544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.584379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.584693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.584971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.585706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.587983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5ef5-e2cb-406b-9e51-2e32ae292073 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.660827 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826580d-4f49-4987-b821-ae5f7677da5f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.689011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:09.703826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/474] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:09 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:09.704842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.705130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.705409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.712266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.713010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.713297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.713812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.715146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:09.716438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.717927 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.730737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:09.732842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:09.734062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 242/475] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:09.740664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.840087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/476] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:09.874459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:09.883336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d6f55-464e-4bf5-ad2c-ca2a4bb634fe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:09.928289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:09.928987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:09.929267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:09.929543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:09.930265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:09.931720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:09.991591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:10.000642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91621-31df-4ca6-9d9a-24df3a508cbe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:10.023170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 243/477] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:09 2022] POST /identity/v3/users => generated 249 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:10.050326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:10.051027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:10.051309 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:10.051588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:10.052382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:10.053869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:10.100082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 10 12:45:10.100082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 10 12:45:10.100082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [parameters: {'id': 'cb350f2180ff4d129f06fd1c513be15a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 10 12:45:10.100082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jun 10 12:45:10.122756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return ref.to_dict() Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:45:10.123675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 10 12:45:10.124586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 12:45:10.125480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:45:10.127463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:45:10.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'id': 'cb350f2180ff4d129f06fd1c513be15a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:10.131386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 10 12:45:10.133474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:10.135394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/478] 10.222.0.10 () {60 vars in 1131 bytes} [Fri Jun 10 12:45:09 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:10.142258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:10.201124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:10.271686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8755dc-4e8e-4344-b16f-ae13449820ee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:10.311986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:10.312887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:10.313164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:10.313441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:10.324858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-67fd17fc-562d-48f6-9a1a-c61c456d536f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:10.333022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:10.335476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:10.336254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 244/479] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:10.343398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:10.467727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e195c4-4a91-46c7-94ac-4e24098c4758 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:10.503505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:10.504172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:10.504456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:10.504771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:10.505529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:10.505832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:10.507208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d305ed-f4f0-48d4-b814-015787c7093a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:10.517053 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/480] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:11.573993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7be4f-e659-4ab9-9364-871841b5f159 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:11.574693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7be4f-e659-4ab9-9364-871841b5f159 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:11.575089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7be4f-e659-4ab9-9364-871841b5f159 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:11.576862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 245/481] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:11.582028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:11.582516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:11.582786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:11.603236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:11.604419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:11.623021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:11.697931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/482] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:11.743554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7be4f-e659-4ab9-9364-871841b5f159 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:11.885709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:11.889467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7be4f-e659-4ab9-9364-871841b5f159 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:11.936380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:11.937205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:11.937488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:11.937762 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:11.955285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:11.963031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:11.964436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:11.965721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 246/483] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:11.972225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.099125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa5656-eff7-46fe-86e4-c6c2963a2e2b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.138575 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.139158 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.139442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.139717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.140464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:12.140803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:12.142178 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0980238-4e2a-4716-9ce7-469506e7b3a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:12.150597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/484] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:12.157695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.165903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331f9d-c345-471b-a581-f0cc5f334650 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.166455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331f9d-c345-471b-a581-f0cc5f334650 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.166926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331f9d-c345-471b-a581-f0cc5f334650 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.168843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/485] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:12.174340 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.174865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.175337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.207584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:12.209117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:12.214443 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:12.324267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8c177-f9b0-460c-b023-38cd94b15884 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.348892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/486] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:12.373066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.374225 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.374705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.375172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.392040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:12.393878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:12.418368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:12.419273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:12.420348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:12.420348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:12.420348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:12.420348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:12.427013 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 247/487] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:12.431504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.440763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.467957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:12.560651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74602ac1-5269-4071-a901-381d031eb9ce None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.579270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca712e-f083-49a0-b735-1e44ff8a7c06 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.596050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.596878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.597159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.597431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.611036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-90152a15-ff9e-4108-bdb0-65a79bd29abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:12.621166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:12.622314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:12.623298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:12.629654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 248/488] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:12.629654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be7888-4fe5-438f-b681-5f3c5c2b6a71 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.629654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be7888-4fe5-438f-b681-5f3c5c2b6a71 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.629654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be7888-4fe5-438f-b681-5f3c5c2b6a71 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.629654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 249/489] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:12.633734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be7888-4fe5-438f-b681-5f3c5c2b6a71 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.647098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.648809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.649235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.650049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.651199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:12.652190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:12.654678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f323a2-534b-42ec-add9-e4d796f56f7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:12.666601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:12.673191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/490] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:12.677056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.677056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.677056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.699450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:12.701846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:12.731158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:12.773020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be7888-4fe5-438f-b681-5f3c5c2b6a71 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.808647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/491] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:12.808647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.826351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.827452 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.827929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.828473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.829461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:12.830037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:12.831665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:12.852466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 250/492] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:12.853348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.913613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbe29c-4f7f-423b-82e1-4589254ed432 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.943919 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:12.951583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.952393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.952705 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.959578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:12.959691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0f5ec-b7ce-4e71-8fe0-a02a1f804403 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:12.960507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:12.961989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:12.978195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:12.979115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:12.980530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/493] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:12.981258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:12.997593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:12.998383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:12.998669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:12.998946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.000835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.010745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-384286ca-a51e-4aa7-81d9-79ba3143ee7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:13.019607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:13.020504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:13.021341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 251/494] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:13.022515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b874f-13ee-4b84-9e43-484b3d742af8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.022515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b874f-13ee-4b84-9e43-484b3d742af8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.022675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b874f-13ee-4b84-9e43-484b3d742af8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.024040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 252/495] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:13.032661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b874f-13ee-4b84-9e43-484b3d742af8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.094292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80a7d7-90b4-4966-b809-135855bf3c97 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.129442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.130227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.130507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.130838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.131928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b874f-13ee-4b84-9e43-484b3d742af8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.141675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.143357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:13.162419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:13.163286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:13.164187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:13.164187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:13.164187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:13.164187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:13.164187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/496] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:13.164455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.172069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.172774 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.173057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.173331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.174167 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:13.174470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.175880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408016b8-8aa2-458e-a8e0-efa57203c0c0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.208878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.212987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 253/497] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:13.214247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.214542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.214818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.232483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:13.233693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:13.272380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eca6d6-17d4-44d0-9d6d-507ccb0f9247 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.334091 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.364648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.364858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 254/498] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:13.364950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.365032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.365112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.365112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.365112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:13.365112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.365112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.369704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/499] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:13.371270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.471065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da60266-d0f4-4c4c-9901-00b20a2b6ffc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.472331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da919817-5263-44cb-9c0e-e2acc7a2b8c0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.474609 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.505550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.506200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.506483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.506760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.506946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.507472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:13.507568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.507777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.507862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.508121 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.509212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.520367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 255/500] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:13.521195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.565238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.580813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.582288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213dddd9-db4e-4685-a89e-f144731d91f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.623095 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140494e-5b4e-49d5-91a8-1e86d0392fac None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.656557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.657366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.657649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.657922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.668792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.670476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.685136 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/501] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:13.686451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332844-bd87-4a51-85c5-0f2df2e8765a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.686743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332844-bd87-4a51-85c5-0f2df2e8765a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.687023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2332844-bd87-4a51-85c5-0f2df2e8765a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:13.687215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:13.687999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:13.688866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:13.688866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:13.688866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:13.688866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:13.689072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/502] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:13.689537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2332844-bd87-4a51-85c5-0f2df2e8765a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.692915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 256/503] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:13.693845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.695487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.784167 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.790255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc15b-1122-488b-be47-45ce63de1030 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.791586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2332844-bd87-4a51-85c5-0f2df2e8765a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.824567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.825436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.825716 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.825918 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.826050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.826706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.826986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.827259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.832793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.834220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.837180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:13.846005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:13.847092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/504] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:13.852604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:13.853399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:13.854193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 257/505] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:13.855150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:13.914819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:13.951266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919cbc6-f2bc-4435-8b35-6e723fcffc16 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.951772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11b0e0-1e31-4e0b-b072-02669faf90d5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:13.983578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.984222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.984505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.984810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.985203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:13.985516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:13.985822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.985981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:13.986265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:13.986541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:13.987197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658505e9-7884-4090-a5fc-f82273452e7b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.996981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:13.998428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:13.998665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 258/506] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:13.999845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.000131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.000407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.016969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:14.017740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:14.018716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:14.019620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:14.019620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:14.019620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.019620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:14.019826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:14.019902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/507] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:14.019902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.031192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.088391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 259/508] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:14.089220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.118439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bca28-fe0f-47f5-be2e-62b288b29e3e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.135408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.154317 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222396-955a-4089-b1d8-174201a7677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.154984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222396-955a-4089-b1d8-174201a7677f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.155273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222396-955a-4089-b1d8-174201a7677f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.155557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222396-955a-4089-b1d8-174201a7677f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.156308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222396-955a-4089-b1d8-174201a7677f None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:14.156630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222396-955a-4089-b1d8-174201a7677f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.158050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222396-955a-4089-b1d8-174201a7677f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.171855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/509] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:14.171855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222396-955a-4089-b1d8-174201a7677f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.198020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ab062-4d5c-4882-a153-e9eeef0957f7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.233246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.233907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.234186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.234470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.235296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:14.235604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.237074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.253781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 260/510] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:14.254574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.257144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.277396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222396-955a-4089-b1d8-174201a7677f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.315659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.316440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.316747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.317015 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.324300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.325789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:14.340718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:14.341670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/511] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:14.342563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.356987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f147a-032a-4f81-ac77-fdb7683058f3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.385308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.393459 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.400689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.411864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 261/512] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:14.412714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.453255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d04253-a2f3-4a32-897e-b5130bef8f68 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.484312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.490272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.492308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.492308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.492308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.502972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.504448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:14.522938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:14.524009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/513] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:14.525145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.533002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df48912-bd46-45a5-9bc5-04c05e624f1a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.568999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.569782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.570072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.570345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.581226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.582687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:14.599801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:14.600768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:14.601593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:14.601593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:14.601593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:14.601593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:14.601593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 262/514] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:14.602148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.626112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.635521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75544e-5a99-4b9f-8ddc-3f411eeca6c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.671424 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.672071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.672353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.672641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.710304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44cfbf-e37a-4997-ba31-292b034df66f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.725139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.743787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.745822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.746488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.747154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.747441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.747717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.748552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:14.748928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.750441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.768995 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 263/515] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:14.769826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.843001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:14.853825 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/516] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:14.855239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.878137 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e823af6-e6e5-4bc1-9bb6-6636ccff6b76 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.920637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:14.921424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:14.921702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:14.921978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:14.928972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:14.930437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:14.954014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:14.955118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 264/517] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:14.956025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:14.969975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e4deb-6787-40ae-9f51-a4c18e40f373 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:14.991161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.006736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.007390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.007672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.007943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.009094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.009399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.010945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.022939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/518] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:15.023759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.067749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ee26-e9ad-4648-afee-c918cc3ee984 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.078598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.108126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.108752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.109051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.109326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.110060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.110372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.112175 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.124915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 265/519] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:15.125758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.130754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c455-1dd7-4221-ae9e-c4820198eaa0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.165536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.166179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.166458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.166732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.216969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.225133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f9207-89c6-4c7c-b156-9932c95fed08 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.234995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.236467 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.258576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.259353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.259643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.270308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.271757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.288815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:15.289701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:15.290521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:15.291354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:15.291354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:15.291354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:15.291354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:15.291354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 266/520] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:15.291768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.340359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/521] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:15.341218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.397106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e3aa-9e1e-4a17-b388-6d9c58e7de34 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.430592 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.431239 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.431519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.431789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.432560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.432915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.434324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.438216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511b0cf-4709-4ff1-9020-f9d2299134b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.451849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 267/522] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:15.452671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.456034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.472194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.472885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.473162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.473433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.474127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.475603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.543916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/523] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:15 2022] POST /identity/v3/users => generated 247 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:15.545367 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.554917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.562624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c69fc-3656-40cf-8586-a3350e9c93bc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.602680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.603509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.603798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.604080 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.617545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.619076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:15.636957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:15.638222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:15.639154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 268/524] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:15.639738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.670948 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ce470-4e54-41ac-bab5-d2e4e6d10491 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.707346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.707980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.708113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.708284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.708557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.709326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.709631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.711009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.724277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/525] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:15.725159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.756184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b42d1-c2dd-4b6d-afcc-3f4d0498ab66 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.795293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.796128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.796451 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.796766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.797339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.810361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.815088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:15.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:15.830240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 269/526] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:15.835796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.839990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6900f-53d2-45d8-8e8f-062efa25421d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.876276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.877081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.877431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.877779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.878688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=1c6c076588d9458784247cdfec12c4ce) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.880610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:15.886539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/527] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/role_assignments?user.id=1c6c076588d9458784247cdfec12c4ce&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:15.897686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:15.944466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d034a6-b5c7-4e22-90c8-910b897e9516 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:15.965556 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:15.986576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:15.987506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:15.987961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:15.988368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:15.989412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:15.989916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:15.991577 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.019148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 270/528] 10.222.0.10 () {56 vars in 1139 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:16.020384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.048674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf55e87-a892-44d2-840e-ebd38bd50460 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.081234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.087396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.088406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.089087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.089509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.096774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.098407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:16.114599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:16.115618 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:16.116663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:16.118737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/529] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:16.119826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.147659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff18c37-61ba-467c-aae4-63c34237ed51 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.196334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.197269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.197692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.198103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.199948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:16.200971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.202763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.223798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 271/530] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:16.224879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.240858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e7590-e868-4403-8e22-f64bcf87c1f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.268135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.276168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.277258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.277581 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.277713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.337721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.343667 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba956d-bc1b-41da-ba14-27cbc6ce4708 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.350678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.352850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.383748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.384668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.385121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.385592 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.386651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:16.387100 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.388748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.402550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 272/531] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:16.403740 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.486598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/532] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:16.486598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.524441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.531978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef03e98-5f9b-4810-ab2e-37afd3c70b57 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.566937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.568043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.568517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.568986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.575840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.578516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:16.593246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:16.594135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:16.594982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:16.600519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.600904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 273/533] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:16.601824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.613389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb988ac-5972-4afb-96cd-77e828293820 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.655002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.655914 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.656299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.656713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.657655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=d39acd104e2b41119ce9454dbb4428ff) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:16.658346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.659904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.666232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/534] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/role_assignments?user.id=d39acd104e2b41119ce9454dbb4428ff&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:16.673929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.772045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396926c-55f3-4ca1-ae0b-f3653aac93fc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:16.816548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:16.817635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:16.819085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:16.819589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:16.844542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:16.847249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:16.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:16.882304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:16.883414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:16.883414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:16.883414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:16.883414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:16.893246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 274/535] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:16.895466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:16.912054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:16.928516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d28df-5c28-45f7-869d-26fcffc306ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:17.003259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:17.004191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.004664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.005102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.006598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:17.007214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:17.009292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:17.046502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/536] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:17.054694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:17.086919 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:17.170911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf326-6a82-4146-a2b4-36e30b1e2b05 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:17.180925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a644a4-2f81-486f-9747-db9089dbc301 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:17.216594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:17.217441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.217820 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.218194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.219130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:17.224967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:17.224967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:17.227363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/537] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:17 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:17.298461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:17.299386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.305396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.305889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.306897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:17.307354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:17.309898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:17.323379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 275/538] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:17.329506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:17.472994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:17.505954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a73fcc-549c-4acc-895f-4d43f11e5fa0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:17.571256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:17.571974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.576546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.576546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.588064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:17.592641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f809ca46-02f2-4cc0-a4f6-9ad3723fba41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:17.632813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:17.633648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:17.634482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:17.637603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/539] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:17.645707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:17.756245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:17.851552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf6bae-a1ce-404d-a8b1-ebbd14d34ecc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:17.930076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599846-4845-42e0-a450-b8a4d8de923d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.930579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599846-4845-42e0-a450-b8a4d8de923d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.930683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1599846-4845-42e0-a450-b8a4d8de923d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.931995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/540] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:17.943135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.943135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.943135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.958028 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933499-e46e-4517-a903-54d25543115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:17.958660 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933499-e46e-4517-a903-54d25543115f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:17.958959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933499-e46e-4517-a903-54d25543115f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:17.959240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81933499-e46e-4517-a903-54d25543115f None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:17.960042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933499-e46e-4517-a903-54d25543115f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:17.960656 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933499-e46e-4517-a903-54d25543115f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:17.961841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81933499-e46e-4517-a903-54d25543115f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:17.986211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:17.987442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:17.989857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 276/541] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:17.992394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933499-e46e-4517-a903-54d25543115f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.102194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/542] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:18.126751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81933499-e46e-4517-a903-54d25543115f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:18.142476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.181010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:18.199762 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:18.200466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.202811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.203134 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.205325 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=2fda4f42ba344b4f960ed39a006b887b) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:18.209123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:18.209123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43079fa-a8b1-4b6a-9ac8-c54e1aced054 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:18.218045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 277/543] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:17 2022] GET /identity/v3/role_assignments?user.id=2fda4f42ba344b4f960ed39a006b887b&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:18.248750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:18.301191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c10236-79f6-4cc4-a503-f2c8c838bb98 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:18.356504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f44b-6be3-4fc0-a59f-b3d30941ec17 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.356794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:18.356998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f44b-6be3-4fc0-a59f-b3d30941ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.357376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f44b-6be3-4fc0-a59f-b3d30941ec17 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.358035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.358485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.358898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.359346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 278/544] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:18.367753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.368048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.368334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.383407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:18.397421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:18.398552 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:18.399511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:18.403044 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/545] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:18.407351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:18.409132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.412513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:18.542881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 279/546] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:18.559977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7845356-bcfb-4a54-8905-c370c7949490 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:18.580000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.619568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:18.636647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:18.637330 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.637617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.637896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.640966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:18.641282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:18.642676 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:18.668132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/547] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:18.674062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.794006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315855-cabd-4166-82f3-53d672ce5acc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:18.823597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633f86a-418a-4806-9952-88cd4b1d5cbc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:18.841952 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:18.843731 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.844409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.846274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.860541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:18.870566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:18.871497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:18.887748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:18.890733 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:18.891229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:18.893198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:18.903923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:18.904800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:18.906128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:18.906128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:18.906128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:18.906128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:18.916204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/548] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:18.920677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.923071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:18.936645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:18.937723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:18.938571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 280/549] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:18.943839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:18.988979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.107068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5705-1c02-4379-a7d1-6f0c38d0fb8f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.115343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d3c86-8d5b-4b18-b4ca-d4c8e699b204 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.166086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.166683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.167492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.167761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.168540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:19.168890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.170502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.174475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.175135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.175416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.175689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.176413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:19.176743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.178102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.194207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 281/550] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:19.195992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/551] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:19.200315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.205584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.252055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.313009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455d47b-6148-4008-8dff-53c00cafe38d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.351019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.352304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.353301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.353813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.365457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fcfe3-f489-441d-8b90-975d536b7cd9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.366944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.367867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.370761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0594e219-27cd-4675-b956-77fc916e4795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:19.391997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:19.392940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:19.393837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:19.393837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:19.393837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:19.393837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:19.394472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 282/552] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:19.395842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b951d-daf1-4a85-8f8e-9f9e63cd0ac5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.396138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b951d-daf1-4a85-8f8e-9f9e63cd0ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.396711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b951d-daf1-4a85-8f8e-9f9e63cd0ac5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.400699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 283/553] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:19.402324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b951d-daf1-4a85-8f8e-9f9e63cd0ac5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.415411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.416758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.417658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.417933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.430399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.432195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-770996d9-09a9-4887-bc95-7c308af5e5b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:19.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:19.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/554] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.453569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.454396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.469819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:19.471149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:19.523148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.533914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b951d-daf1-4a85-8f8e-9f9e63cd0ac5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.552640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/555] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:19.552640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.596573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.597565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.598020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.598472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.599466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:19.599949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.601532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.614285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 284/556] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:19.615433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.648234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.659598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b55a5-a81c-44cf-bf71-65debe1407d5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.698537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.699529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.700062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.700487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.701478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:19.701981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.704851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.728706 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dac8a4-f6e1-40a8-9a94-4a8d9532f229 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.749323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/557] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:19.750700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.765491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.766419 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.766811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.767214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.777933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:19.785759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:19.787327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:19.788339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:19.795831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 285/558] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:19.796989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.815759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:19.876076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4404f30e-88a4-4908-ba37-aab410981a63 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.905045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05762ee5-05e4-4a61-b11f-54e33da1eca6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:19.913108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.913902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.914186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.914464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.923154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:19.924610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:19.939983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:19.941002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/559] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:19.941990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:19.945430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:19.946171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:19.946347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:19.946620 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:19.957263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.019637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.021364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ddf22-36c7-4622-927d-00220d3006d1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.036997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.047838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c610e8-5e68-4017-ac58-6335b884155e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.082650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.083311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.083606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.083860 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.084600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.084931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.086295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7a05d-94be-4da2-b382-1a48b9d88bfe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.094665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/560] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.095723 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1da8-0c4b-46cb-8b5c-209e1946ce85 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.096009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1da8-0c4b-46cb-8b5c-209e1946ce85 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.096283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f1da8-0c4b-46cb-8b5c-209e1946ce85 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.097896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/561] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:20.098464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1da8-0c4b-46cb-8b5c-209e1946ce85 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.134820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 286/562] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:20.136164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.136451 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.136755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.154980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:20.156159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:20.179197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.210784 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f1da8-0c4b-46cb-8b5c-209e1946ce85 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.232271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 287/563] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:20.237560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.253290 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.254578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.255556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.256330 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.258014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.258700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.260234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.300419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/564] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.304807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.309530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.365086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9907af9-d2ed-4411-9bae-1d0a1bc94c27 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.401204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.402169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.402549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.402925 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.405639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934bc13-41a1-4665-a88d-c8b6c960d025 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.413267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.414837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:20.432351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:20.434012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:20.435078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:20.435078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:20.435078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.435078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:20.440243 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 288/565] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:20.440243 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.443025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.450940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.451879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.452162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.452441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.467903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.467903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:20.482642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:20.483684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:20.484573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:20.484573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:20.484573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.484573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:20.484573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/566] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:20.485071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.547508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.555315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523becf-1371-4ebd-80ce-5d4caaf910fe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.594472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.595506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.595944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.596220 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.602317 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f698-7ea1-4a42-8927-1e02941ed67b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.607995 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:20.615727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:20.616862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:20.617779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 289/567] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:20.618467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.643516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.644315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.644601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.644898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.655367 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.656187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:20.673910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:20.674864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:20.675744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:20.675744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:20.675744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:20.675744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:20.675744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/568] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:20.676027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.708645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.724896 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31f67-2028-4ac1-94f8-e847363872eb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.757904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.758557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.758840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.759116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.759833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.760140 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.761594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914083f2-6c48-49a3-9039-1247071488ba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.772921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 290/569] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.773835 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a709329-5ad6-4e70-a727-d41924d0c4f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.774127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1c1-623d-4024-9b95-712694d80047 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.774413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1c1-623d-4024-9b95-712694d80047 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.774689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6f1c1-623d-4024-9b95-712694d80047 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.776058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 291/570] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:20.777499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6f1c1-623d-4024-9b95-712694d80047 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.798571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.809735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.810393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.810671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.810943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.811654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.811983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.813391 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.825056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/571] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.825870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:20.884917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6f1c1-623d-4024-9b95-712694d80047 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.916746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:20.918471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.919227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.919605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.920224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.921095 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.921500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.922932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ae920-1b8d-4c93-83c7-01db275591d2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.924479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31e1a8-9df2-423d-a5ff-f5b9488a37e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:20.930800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 292/572] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.931977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.932543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.932671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.948591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:20.949906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:20.958551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:20.959210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:20.959495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:20.959774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:20.960646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:20.960966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:20.962347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:20.974181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/573] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:20.975025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.017504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 293/574] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:21.018341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.028539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.087091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ac94-671c-491a-935e-3b856ba0ccb4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.119137 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5d42e-1dc8-45b8-a10e-18f581e81c96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.121329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.122248 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.122528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.122897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.131298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.132790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:21.146542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.147672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/575] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.148797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.155647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.155821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.156003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.156275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.163014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.164454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.168402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:21.178463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.185672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 294/576] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.186795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.244936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.256769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a4fd-f2b3-47e7-b490-2deefb012d67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.281948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c54849-cd79-4565-9ec4-0556e75201c7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.297574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.298350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.298629 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.298905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.309490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.310916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.315036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.315820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.316106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.316376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.322867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.324920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:21.328206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.329212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:21.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:21.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:21.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:21.330113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/577] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.330391 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:21.338837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.339767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:21.340871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 295/578] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.341411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.405966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.440921 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a147d9-479f-4d79-b1ff-c240bfee9054 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.444805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea8666-c005-406f-a58f-0b092b1c2aa7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.472763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.473780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.474572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.474856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.475131 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.480807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.481457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.481738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.482009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.482833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.483137 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.484680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.485584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:21.493192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.494273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/579] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.495429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.501757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 296/580] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.502570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.591801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1a54-9f1c-4c74-9d89-da08d7de0161 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.598831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6836a-bce2-46d4-9224-a3616da7269c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.624985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.625641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.625923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.626216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.627030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.627337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.628787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.632386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.633070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.633355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.633630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.634344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.634648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.636553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.641159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/581] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.641963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.652739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 297/582] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.652739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.737379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c13c2-fc28-4756-b817-c51daa7ec368 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.740281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.746622 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85bde1-6cb3-4982-940a-98a8ee9b2230 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.768785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.771721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.772373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.772677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.775232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.775232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.775232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.775526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.780057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.780763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.781084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.781395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.782165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.782507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.783883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.787262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/583] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.787947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.793092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 298/584] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.793905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.835022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.889676 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a91f15-186c-474a-8ea1-c2f1f62f90e7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.893350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6a77a-3803-4202-bc93-417e9d0aa744 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:21.902545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:21.923716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.924505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.924825 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.925133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.927152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:21.927811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:21.928126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:21.928433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:21.929328 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=0042ad86624e4eb08844d9112381820e) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:21.929658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.931183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.935750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:21.937126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 299/585] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/role_assignments?user.id=0042ad86624e4eb08844d9112381820e&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:21.937271 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:21.937908 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:21.955102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:21.956087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:21.957030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:21.957030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:21.957030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:21.957030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:21.957030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/586] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:21.957325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.060706 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9d56d-71d8-49e1-a41e-f63e67e8d304 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.069543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.074050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c114827e-867d-4839-abe3-e3f020fee85d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.100263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.101103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.101485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.101795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.110957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.112445 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.120055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.121106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.121392 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.121668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/1c6c076588d9458784247cdfec12c4ce/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:22.126547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:22.127443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 300/587] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:22.128991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.144115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=1c6c076588d9458784247cdfec12c4ce, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.145770 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.161700 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.213283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/588] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:21 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/1c6c076588d9458784247cdfec12c4ce/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:22.215621 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.241003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd024-6345-4089-a10c-744a4d5c922c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.281730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.282567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.282884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.283194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.295851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.297544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:22.317752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:22.319069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 301/589] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:22.320498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.371004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66254-12f6-43c7-b623-dc08429dd22e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.410771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.411807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.412319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.412829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.413803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:22.414327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.416023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.433381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/590] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:22.433688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.434781 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.447333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.452836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3785826-7976-41c5-b626-6b7c363f770d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.499050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.500474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.501258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.501721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.503971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:22.505138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.508407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.533534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 302/591] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:22.535043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.556343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579efe28-7f56-4581-9c45-9701621635ce None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.602490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.603745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.604237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.604905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.606305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:22.606843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.608638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.625450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/592] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:22.626645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.665948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a08b3-7bef-47d1-b3e1-909a3cd8054b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.713558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.715156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.715783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.716746 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.717185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.726292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.728465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:22.748723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:22.749909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:22.751033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:22.753514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 303/593] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:22.754579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.755856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126262e2-61fb-471c-a95f-394fe976ceb4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.758539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.793724 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.794531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.795070 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.795341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.806898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.808566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:22.826579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:22.827503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:22.828407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:22.828407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:22.828407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:22.828407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:22.832430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/594] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:22.833161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.865880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8f498-8f21-42cd-afd0-553a11a87c3d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.903502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.904295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.904582 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.904893 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.913615 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:22.915179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:22.931555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:22.933641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 304/595] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:22.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:22.937844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06c56-0c38-411a-b21c-c2e28af995af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:22.972720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:22.995282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:22.996525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:22.997477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:22.998313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:22.999597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:23.000520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.002665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.004150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.028398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/596] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:23.028398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.054929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23266b6-ee6d-494b-844a-88cd11838ab0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.093894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.094984 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.095542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.096192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.097148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:23.097692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.099478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.113907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 305/597] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:23.115116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.140824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f368c1-1b8b-44ce-9156-f7c2ac607ce2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.176802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.177478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.177764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.178043 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.178888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:23.179203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.180648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.203968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/598] 10.222.0.10 () {56 vars in 1139 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:23.203968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.234051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e5655-9e0d-46b5-ac87-2926cc1899c9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.242034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.260280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.272932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.274167 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.274621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.275118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/d39acd104e2b41119ce9454dbb4428ff/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.321713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=d39acd104e2b41119ce9454dbb4428ff, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.324507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.340783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71c94-7437-4d1d-bbd3-bd00d3dc599b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.377056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.377847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.378133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.378410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.385270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.387139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:23.404726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:23.405666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/600] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:23.406525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.408350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 306/600] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:23 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/d39acd104e2b41119ce9454dbb4428ff/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:23.409731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.617126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.622462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90eb54c-8e55-4bb6-927a-f9ed110fad75 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.637854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bc75a-fdd0-4b74-80f3-371c6874ecda None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.658854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.659874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.660360 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.660812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.674011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.675538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.679669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.680553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.681145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.681608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.683705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:23.684294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.685969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:23.699066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:23.699980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:23.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:23.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:23.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:23.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:23.700898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/601] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:23.701559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 307/602] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:23.704490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.705965 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.754075 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.831491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4afc47-d56a-4ad9-8d5c-3aa2f85d5053 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.872965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.873861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.874149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.874425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.890739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=b91f8654801b49689bb5774097b59bb5, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.892438 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.914723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da1fa0-77c3-405c-a78f-84789b367954 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:23.953278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:23.954116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:23.954305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:23.954545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:23.955346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:23.955656 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:23.957176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:23.971529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 308/603] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:23.976859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:23.992105 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:23.999936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/604] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:23 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:45:24.100578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:24.111272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438f2b-cb43-4939-aa86-27ab0f6583c6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.172371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.173175 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.173462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.173791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.190107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:24.191787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bebc0f09-7f1b-45cf-954a-496fb14a78c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:24.214289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:24.215541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:24.216637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:24.220783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 309/605] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:24.225741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.228942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8101bf-b4e5-406e-8727-5f59d33d170d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.229240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8101bf-b4e5-406e-8727-5f59d33d170d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.229786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8101bf-b4e5-406e-8727-5f59d33d170d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.231859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 310/606] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:24.237425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.242157 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.242157 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.258685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:24.260022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:24.352834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 311/607] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:24.378232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.399471 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb579f4-8a12-4c8b-b5b2-e02d4babc410 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.460480 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:24.473690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.476703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.476703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.476703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.476703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:24.476703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:24.478436 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:24.495616 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be25f9-397b-4ae1-bf1b-e3f79aa85b56 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.505232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/608] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:24.510922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.530812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.531606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.531887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.532164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.543681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:24.551819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:24.552917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:24.554266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 312/609] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:24.561656 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.673226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77a228-4e95-4765-8e2d-870d109e75a6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.687520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:24.717641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.718527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.719304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.719976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.721048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:24.721753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:24.723512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46b3a-370f-454e-98ac-d2306d68547c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:24.727236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e2a3-8a79-47f6-9019-7b5fa1be7058 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.733719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 313/610] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:24.735454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d911-3b02-486e-b28e-4c6a717d3fbd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.735744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d911-3b02-486e-b28e-4c6a717d3fbd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.736020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d911-3b02-486e-b28e-4c6a717d3fbd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.741792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 314/611] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:24.742703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d911-3b02-486e-b28e-4c6a717d3fbd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.761121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:24.771152 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.784978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.784978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.784978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/2fda4f42ba344b4f960ed39a006b887b/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.792405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=2fda4f42ba344b4f960ed39a006b887b, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:24.794533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e476aae-e6cc-4c22-be9d-4a55a30185c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:24.848123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d911-3b02-486e-b28e-4c6a717d3fbd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:24.868476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/612] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:24 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/2fda4f42ba344b4f960ed39a006b887b/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:45:24.870876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.871215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.871543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.892174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:24.893532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:24.894026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:24.894356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:24.894859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:24.895647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:24.911672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:24.913962 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:24.957126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:24.958518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:24.959403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:24.959403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:24.959403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:24.959403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:24.959403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 315/613] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:24.964870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:24.992856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/614] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:25.030670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.061319 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.077544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.107416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a969ff2-5a31-473a-9ea0-ec5354330508 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.140793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b99c7-c68d-4526-9654-0aa74192b677 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.145792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.146453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.146735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.147009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.147723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:25.148026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.149412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.162249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 316/615] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:25.169133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.180190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.181037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.181325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.181601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.192755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:25.201030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:25.203120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:25.204389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/616] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:25.208700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.282430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1519-e8f7-4d00-a4ec-b5743954b0c2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.301669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.331273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.332123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.333480 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.333767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.340796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.344190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd0491-1663-400f-80c0-ff59aad4d686 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.349862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.351305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:25.380285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:25.381564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:25.382671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 317/617] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:25.386113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.387320 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.387768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.388374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.389053 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.389656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:25.390120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.391713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.403869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/618] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:25.411415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.577511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b3471-3768-4e24-b6e5-ccde9e7599bf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.618677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83867dac-2b7e-467a-8810-63b0cebbd996 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.628858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.629646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.629978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.630300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.631197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:25.631513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.634216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.658400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.660129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.660672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.661172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.667431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 318/619] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:25.673251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.683298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.685151 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.709894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:25.713149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:25.714867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:25.716328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:25.716328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:25.716328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:25.716328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:25.716328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/620] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:25.725820 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.768971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:25.786958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646acac-0078-4e48-b8b7-bf1a57a01aa5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:25.828061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:25.829180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:25.829671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:25.830152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:25.846765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:25.848494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:25.867255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:25.868190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:25.869108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:25.869108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:25.869108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:25.869108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:25.875392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 319/621] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:25.876772 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:25.945416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86f3ff-5c38-43ce-8047-42b02c8586fc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.012226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.018382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.019435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.020203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.020756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.021973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:26.022437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.027674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.036314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e241e-9cd0-4f75-bb03-5fe25a086d87 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.038737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/622] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:26.049555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.108079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.109456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.110166 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.110597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.111723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:26.112200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.113767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acccd61-2554-4cb0-b7c5-7fd386ae9d58 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.128505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 320/623] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:26.130214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fea6b-6892-4e48-91b9-5e7013a3b26a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.130657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fea6b-6892-4e48-91b9-5e7013a3b26a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.131089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fea6b-6892-4e48-91b9-5e7013a3b26a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.133227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 321/624] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:26.139660 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.139951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.140233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.161361 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:26.162732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:26.179883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.212690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc828-45ce-4889-9c52-f046ff2f437b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.246914 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.248126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.248656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.249092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.250037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 322/625] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:26.250930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.258947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.260953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:26.277466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:26.278463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 10 12:45:26.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:26.282298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/626] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:26.288299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.347755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.382369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06967a9-41b5-430e-936b-d056ca407148 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.397424 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c3e05-1280-4511-a6f1-e172a2b7f649 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.430267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.431071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.431360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.431636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.435047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.435714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.436000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.436273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.437141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:26.437447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.439040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.440754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.446868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.448923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.461858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/627] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:26.462738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:26.464886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:26.465972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:26.466835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:26.473506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 323/628] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:26.474655 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.572885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489351a-d856-4ec8-a2e2-3f13f49ea150 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.615002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb301af6-f86d-48f2-925a-fec38f104dd1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.621731 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.622532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.622869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.623141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.634078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:26.642501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:26.643483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/629] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:26.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.656083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.656764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.657054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.657330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.662081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.704977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.728105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.729633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.754127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4f9bf-43c9-4a6c-8606-a7f72079b02f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.787898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.788555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.788863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.789135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.789906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:26.790371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.791625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba0a76-46ff-4bec-aab6-5440451ad9d8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.805567 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/630] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:26.806958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab6a-b6f1-4393-9855-26fc0b6e7632 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.807252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab6a-b6f1-4393-9855-26fc0b6e7632 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.807761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fab6a-b6f1-4393-9855-26fc0b6e7632 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.812739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/631] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:26.812739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fab6a-b6f1-4393-9855-26fc0b6e7632 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.843152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 324/632] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:26.843152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:26.877579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.923041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fab6a-b6f1-4393-9855-26fc0b6e7632 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.936678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:26.944720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56686a66-b51e-4a87-96b2-25ba8b731ddc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:26.958741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.959394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.960047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.960324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.961244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:26.961548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:26.962906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4dfb7d-484e-450a-961e-9ce2750b0de9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:26.976229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/633] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:26.977557 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.978155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.978872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.986322 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:26.987261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:26.987552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:26.987832 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/0042ad86624e4eb08844d9112381820e/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:26.995473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:26.996677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:27.008898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=0042ad86624e4eb08844d9112381820e, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.010343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.065132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/634] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:27.065985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.089120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 325/635] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:26 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/0042ad86624e4eb08844d9112381820e/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:27.091486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.210315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70d76-6254-49b3-b020-b427f5141b72 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.212330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.212859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.235223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26040ba1-4e6d-49a8-af91-c42005a5b404 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.251606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09905-7132-431f-b186-db293ae4501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.252778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09905-7132-431f-b186-db293ae4501a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.253305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09905-7132-431f-b186-db293ae4501a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.253722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f09905-7132-431f-b186-db293ae4501a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.265493 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09905-7132-431f-b186-db293ae4501a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.267191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f09905-7132-431f-b186-db293ae4501a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.284379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.285265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.285560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.285845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-32f09905-7132-431f-b186-db293ae4501a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:27.286485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:27.287393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:27.288291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:27.288291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:27.288291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:27.288291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:27.288291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/636] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:27.288578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09905-7132-431f-b186-db293ae4501a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.310313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.312245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:27.332536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:27.333538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:27.334416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:27.334416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:27.334416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:27.334416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:27.336438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 326/637] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:27.337591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.406634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f09905-7132-431f-b186-db293ae4501a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.444324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.445151 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.445439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.445889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.449589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced338-00a7-49d3-bdbd-838e16956151 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.457504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:27.465598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:27.466728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/638] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:27.472522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.493850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.494765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.496064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.496411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.496786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.497603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:27.497983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.499435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccc1f9-ffcb-46b3-8eb8-e96a899ccf52 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.506857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.516963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 327/639] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:27.518354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d1fd-35ae-425d-ab49-59461b4ed49e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.518652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d1fd-35ae-425d-ab49-59461b4ed49e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.518934 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567d1fd-35ae-425d-ab49-59461b4ed49e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.524161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 328/640] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:27.524161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d1fd-35ae-425d-ab49-59461b4ed49e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.593055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b6faf-3152-4111-96ae-c617e6fdb3c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.631416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567d1fd-35ae-425d-ab49-59461b4ed49e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.637457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.638124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.638409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.638683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.639403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:27.639710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.641138 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.653153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/641] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:27.653962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.673801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.674895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.675223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.675501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.676236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:27.676540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.678113 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da9440-342c-4d5f-b171-fc7d346b5d34 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.687634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 329/642] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:27.693126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.693415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.693691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.714515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:27.716578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:27.735137 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.759075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25292074-bdd5-45ee-8fef-3fa341d1374e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.777979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:27.796643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 330/643] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:27.796643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.804017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.804945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.805307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.805658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.814664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.816694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:27.832224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:27.833225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:27.834135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:27.838014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/644] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:27.839335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.902603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340995d2-3f24-4a2f-8b63-a0dd4a5aa33f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.938333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.939120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.939405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.939682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:27.947049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:27.948545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:27.953206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fa3d-cdbb-4650-bc83-85610ae50b92 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:27.962802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:27.964468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 331/645] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:27.965576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:27.995396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:27.996495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:27.996977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:27.997394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.001202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.009582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.014492 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.015111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:28.030388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:28.031253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:28.032129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:28.032129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:28.032129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:28.032129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:28.034253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/646] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:28.035284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.070503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5e01e-2ab1-4c97-834d-2d5410283bfa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.106062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.107487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.107945 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.108360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.118665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:28.127693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:28.128842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:28.129855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:28.135830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 332/647] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:28.135830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.148580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25e41-d0b2-462d-818a-92e4d2ddb836 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.186442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.187146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.187428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.187850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.188649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:28.188996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.190434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.208937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/648] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:28.208937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.245173 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bd96d-b41c-4a69-8420-1a3d2a729135 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.255890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.264818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.280768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.281440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.281725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.282002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.282836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:28.283145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.284569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.306765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 333/649] 10.222.0.10 () {56 vars in 1137 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:28.307744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.322591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11664327-8ef2-47df-8df0-1a9a1682a053 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.359027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.359695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.359979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.360259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.361016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:28.361329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.362696 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.379339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/650] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:28.379339 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.420343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c2361-60dc-48f6-9f06-0dc962b8ad37 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.457820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.458726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.459154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.459593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.460334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:28.460675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.462014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.470912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 334/651] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:28.471715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.488603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb435525-6591-4d5e-8458-1106c3531778 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.499451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.506479 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.525341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.525989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.526431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.526707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.527525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=1c6c076588d9458784247cdfec12c4ce) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:28.527832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.529294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.535737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/652] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/role_assignments?user.id=1c6c076588d9458784247cdfec12c4ce&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:28.536785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.595730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a80c16-f545-414c-bc5c-9c1de2860114 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.641128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.641800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.642090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.642369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.673489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac87f-aeba-4430-832e-33d1785ec8ed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.711756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.712958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.713455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.714509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.722634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.724384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.726506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.728081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:28.742023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:28.743001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:28.744035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:28.746764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/653] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:28.747551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.766381 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.787139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:28.861530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 335/654] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:28.862714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.881511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dcd2a-77b4-4481-8d77-795c70aad7b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:28.931122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:28.932193 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:28.933219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:28.933807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:28.946036 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:28.947569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:28.966615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:28.967582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:28.968476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:28.968476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:28.968476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:28.968476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:28.968476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/655] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:28.973304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:28.990596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee153-f166-42e7-a005-15b615919140 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.031570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.039753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.040715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.041008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.041295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.042805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:29.046882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.046882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.066916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.075070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 336/656] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:29.075070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.088803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034f56-91b3-4188-9e1d-31562bc19910 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.134320 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.135123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.135466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.136096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.150775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.153818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:29.178239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:29.179194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:29.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:29.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:29.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:29.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:29.180708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/657] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:29.180998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.201047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29358a2b-d3fb-41de-8b2b-4335f66260a8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.252227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.253254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.253693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.253976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.254712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:29.255025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.256464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.268658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 337/658] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:29.269347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.301826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69a7f9-6433-451a-95d0-bba8f93a0e3b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.319803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.338482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.340002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.340286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.340559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.345993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.373677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37413c68-9381-4f06-96a5-db172ca75e67 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.407550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.408205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.408486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.408793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.409501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:29.409813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.411187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb9f513-17ce-4c6e-8ddd-1dd39f33255c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.422106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.423546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 338/659] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0d1d-5783-42a2-b530-43ed3c962fd5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0d1d-5783-42a2-b530-43ed3c962fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0d1d-5783-42a2-b530-43ed3c962fd5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 339/660] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:29.429414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0d1d-5783-42a2-b530-43ed3c962fd5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.532264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0d1d-5783-42a2-b530-43ed3c962fd5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.540634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/661] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:29.540634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.544478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.570530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.571244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.571527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.571798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.577841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.579411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.581150 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ae75c119-8241-475c-9ce0-44f336171268 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:29.595928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:29.599380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 340/662] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.600371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.601205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.626263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:29.627441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:29.655923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539c648-a771-4194-8f02-62e2f7a77187 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.692845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.693645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.693931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.694209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.703834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.703834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.704943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 341/663] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:29.706749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:29.718347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:29.719261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:29.720147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:29.723495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/664] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:29.725266 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.815042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.819276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077913-a184-4d6f-95a0-9d0d79b0c6b3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.827665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:29.834087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fa5e2-599b-4207-a6ac-309f1897c66f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:29.855996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.857644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.858196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.858599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.868905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:29.869579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:29.869974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:29.870350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:29.871288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:29.871600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.872535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:29.873043 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.874300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:29.890665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/665] 10.222.0.10 () {56 vars in 1139 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:29.891487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:29.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:29.896687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:29.897791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:29.897791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:29.897791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:29.897791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:29.900519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 342/666] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:29.902169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.009561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a505f7e-4089-477b-8859-b057904c3148 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.012380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4292c5a-06b7-47a1-817e-8dc04d3cbc2e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.045823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.046504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.046794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.047076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.047291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.047860 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.048069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.048165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.048349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.048695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.049643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.059355 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:30.066595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 343/667] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:30.066595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:30.067527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:30.068409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/668] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:30.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.084403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.088034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.173390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56275a93-2783-4c48-9ac9-8ae8c70f153a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.173868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953c4cf-b341-4a93-9193-89198d5893ea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.207788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.208312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.208719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.208826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.208977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.209073 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.209251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.209531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.210254 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.210563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.212041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.224219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/669] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:30.225069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.284221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.286355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.300659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.303941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.330032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e167-aca9-44b9-b3d6-19ceba4afe92 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.363947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.364506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.364831 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.365104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.365923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=d39acd104e2b41119ce9454dbb4428ff) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.366235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.367653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.384668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/670] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/role_assignments?user.id=d39acd104e2b41119ce9454dbb4428ff&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:30.384668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.413978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 344/671] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:30.414943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.525216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b29c5-a71c-4506-8ebf-b57a93d745e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.549172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dcf90a-6db8-4966-a5f3-87e707639391 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.563270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.571994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.582139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.582565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.591691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/672] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:30.592628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.592770 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.593529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.593815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.594087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.601889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.603407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:30.621813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:30.622808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:30.623767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:30.627854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 345/673] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:30.630055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.712868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab93e28-29e3-4337-8417-baf15e694650 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.745518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bea30-b868-4f53-b1eb-7f42354f4f0b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.750058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.750856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.751142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.751417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.762205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.763713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.782278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.783093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.783375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:30.783480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:30.784323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:30.785255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:30.785255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:30.785255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:30.785255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:30.785476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.785546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/674] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:30.785546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.802552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.804228 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:30.825139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:30.827224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 346/675] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:30.829374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.849800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.860700 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:30.900116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfd380-2679-4a19-8417-8f1dfc3b1e27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.938472 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.939131 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.939430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.939685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.940470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.940808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.942238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:30.943021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9ff4c-7a1c-442b-81a1-26e10fec1545 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:30.954837 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/676] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:30.955289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:30.988977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:30.989632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:30.989918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:30.990187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:30.990897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:30.991205 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:30.992589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c55d7-4bb1-44d5-a8a0-5e2cfdf60a12 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.006107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 347/677] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.010023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6df96-4f82-4a35-ba70-4cb85a0c7aa0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.010511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6df96-4f82-4a35-ba70-4cb85a0c7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.010666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6df96-4f82-4a35-ba70-4cb85a0c7aa0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.011953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 348/678] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:31.012664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6df96-4f82-4a35-ba70-4cb85a0c7aa0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.073749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e993-8296-4ee8-9809-64b57fd84a2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.087440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.104103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.109440 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.110102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.110380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.110652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.111626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.111736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.113048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.125389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6df96-4f82-4a35-ba70-4cb85a0c7aa0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.131093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/679] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.131093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.165715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.166460 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.167771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.168135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.169127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.169563 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.171325 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83d868-a4ea-43b7-9248-a93be9f41aa3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.177627 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 349/680] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.178919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.179302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.179676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.206060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:31.207527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:31.263947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9494da0-0ab2-4771-940d-7763c9742095 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.303739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 350/681] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:31.306417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.311866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.313971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.315530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.316040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.329379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.331077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:31.345999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:31.347154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:31.348262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:31.350043 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/682] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:31.353511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.389267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.411162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.441805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd680c7-af2f-42f4-90f9-8b4b3587fd5a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.478389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621f76-f526-4dce-8430-cfce552c7e83 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.483436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.484659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.484659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.484841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.493894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.496967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:31.513117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:31.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:31.515413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:31.517731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 351/683] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:31.518728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.526928 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.527918 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.528297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.528715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.543314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.545162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:31.568018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:31.569159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:31.570042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:31.570042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:31.570042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:31.570042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:31.572688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/684] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:31.574177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.657117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bcd79-373d-4f57-9480-7b733b74e0ca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.673179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.690724 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f1409-c901-4ec7-b2cc-2964d0ec6bb1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.701349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.701939 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.702222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.702496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.703608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.704064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.705683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.709417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:31.722076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 352/685] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.723862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.739864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.740538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.740852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.741128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.742014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.742324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.743751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.762324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/686] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.763177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.866599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd14d30-f766-420c-b642-472099de7a93 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.876963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759e5e-fdb3-4a4f-9162-15c730ae3f95 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:31.902234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.902947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.903232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.903508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.904230 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.904536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.905980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.920057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 353/687] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.921686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.933373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:31.934808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:31.935318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:31.936235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:31.937713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=2fda4f42ba344b4f960ed39a006b887b) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:31.938509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:31.940532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:31.956933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/688] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/role_assignments?user.id=2fda4f42ba344b4f960ed39a006b887b&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:31.956933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:31.974717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.021847 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.131089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4c69f-5414-4bae-bef6-106520e33efb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.134190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727531a0-d5f9-4d00-84b0-bfdeeca872c9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.176289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:32.177255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.177543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.178068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.179214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:32.181302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:32.190219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:32.191749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.192033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.192306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.268890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:32.270295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:32.287497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/689] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:45:31 2022] POST /identity/v3/users => generated 254 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:32.341534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.395066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 354/690] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:32.400442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:32.480057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.530573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230c7e-e868-453d-be98-68bb1c91d1d8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.567145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:32.567945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.568225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.568497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.580123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:32.581663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2b21152f-0196-4df5-bbf7-d92865b508e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:32.599147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:32.600079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:32.601004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:32.601004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:32.601004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:32.601004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:32.601004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/691] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:32.610672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:32.700371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6621-5e90-4dfc-a090-b2c70e8a26b4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.701064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6621-5e90-4dfc-a090-b2c70e8a26b4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.701538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a6621-5e90-4dfc-a090-b2c70e8a26b4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.703454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/692] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:32.709498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.710025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.710596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.730924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:32.732455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:32.732565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e720-087c-4226-b40b-9974bb5f92d1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.774272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:32.776360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.777055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.777537 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.778461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:32.778966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:32.780547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:32.798092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 355/693] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:32.803489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:32.812829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/694] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:32.827036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.843261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:32.904856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:32.928584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980893f3-636a-4606-8578-dd04ce41a55b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.973329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a859e50-abac-40d7-b089-2119b2d46267 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:32.975497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:32.977274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:32.979206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:32.979630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:32.986854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:32.988532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:33.003142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:33.004051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:33.004999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:33.007517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 356/695] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:33.013390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.014286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.014641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.014897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:33.015000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.018934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:33.018934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:33.034344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:33.038949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:33.039788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/696] 10.222.0.10 () {56 vars in 1129 bytes} [Fri Jun 10 12:45:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:33.041058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:33.176001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:33.210743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799ccd0-de3c-469b-9c8e-740ffc5278da None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:33.241756 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060feee-a945-4a95-99b6-7785d769d463 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:33.258482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:33.279651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.280318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.280600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.280976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.286399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:33.286399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:33.286399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.309698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 357/697] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:33.317599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:33.319420 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.320092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.320746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.320746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.321397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:33.321708 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:33.323683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.337743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/698] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:33.341129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:33.466580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913e173-ba81-4697-a8fd-1e42a20b0907 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:33.525680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fc7fb-d7ab-4b47-a265-437858c32c38 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:33.527749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.528666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.529965 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.530401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.531371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=0042ad86624e4eb08844d9112381820e) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:33.532015 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:33.534408 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e2392-5ec7-4dc3-89f7-4d60e6a4419b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.545619 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:33.551017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 358/699] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/role_assignments?user.id=0042ad86624e4eb08844d9112381820e&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:33.594519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.596654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.596654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.596654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.596654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:33.596966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:33.598372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c51e5-79e2-417d-8877-f5fc18346cbc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:33.613843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/700] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:33.655881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294a6d-6d48-4ce3-a597-902b3aa87f28 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.656223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294a6d-6d48-4ce3-a597-902b3aa87f28 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.656454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd294a6d-6d48-4ce3-a597-902b3aa87f28 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.658326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 359/701] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:33.664342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.664679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.664945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.693009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:33.694240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:33.739464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:33.794110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/702] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:33.820525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294a6d-6d48-4ce3-a597-902b3aa87f28 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:33.935442 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd294a6d-6d48-4ce3-a597-902b3aa87f28 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:33.970666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:33.971508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:33.971792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:33.972114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:33.982703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:33.991062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:33.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:33.993302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 360/703] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:33.998711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:34.123447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eebf08-21d4-459a-b1cf-86ac785d4da7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:34.167848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:34.168526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:34.168834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:34.169106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:34.170122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:34.170428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:34.171817 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:34.180926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/704] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:34.186303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:34.266905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:34.328271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c767d4-c1a7-484b-bc5e-03151e33ef8c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:34.376897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:34.377935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:34.378367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:34.378789 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:34.398508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:34.400180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:34.419405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:34.420568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:34.421520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:34.421520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:34.421520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:34.421520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:34.425311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 361/705] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:34.433867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:34.474567 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:34.559325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0ac37-c7e9-4fd8-80ee-9a6540078ee9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:34.600101 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:34.600890 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:34.601054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:34.601322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:34.602048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:34.602350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:34.603725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:34.620937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/706] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:34.622752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:34.753776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d05a2-730d-4903-9e8b-2bff1a3ceb67 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:34.767209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:34.796097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:34.797345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:34.797994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:34.798277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:34.806622 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:34.808260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:34.827545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:34.828510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:34.829502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 362/707] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:34.834107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:34.971691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:34.988328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b136290-cef3-45b4-a6c2-4098b9110271 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.035002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.035701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.035986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.036266 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.037163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:35.037476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.039029 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb46ece-f53c-4cd4-b813-062ebbb4bc40 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.072337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/708] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:35.077801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.101221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec414-652f-4989-91c1-df9d4a1f0394 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.101561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec414-652f-4989-91c1-df9d4a1f0394 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.101775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eec414-652f-4989-91c1-df9d4a1f0394 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.103395 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/709] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:35.109038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.109325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.109602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.136904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:35.138089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:35.234411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce6a2-da1f-425a-82b4-2cec245bc44f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.235315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/710] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 10 12:45:35.259338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.301352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.303222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.303949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.305224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.379358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.389413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.410935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.412881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.416297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba072eb-ce4f-418f-a5a7-44041b1affc6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.453783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.454577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.454859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.455237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.455894 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.457381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a6d55fb5-b587-4623-8aa9-ab9ef0662ca5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:35.470318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:35.471311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:35.472554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/711] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:35.473373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ef51-ce5b-468b-b3f6-5e25f5837d36 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.473702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ef51-ce5b-468b-b3f6-5e25f5837d36 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.473802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526ef51-ce5b-468b-b3f6-5e25f5837d36 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.480163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/712] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:35.481582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.481867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.482139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.503002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:35.504464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:35.528715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 363/713] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:35.529607 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.583833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/714] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:35.584785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.649103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.667694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5b48d-c561-4938-8b4b-b4e2f1397048 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.686250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.711568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.712482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.713154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.714554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.715411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] RBAC: Adding query filter params (name=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:35.715817 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.717951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.724644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 364/715] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:35.725622 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.726395 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415a20b-49a2-44c2-ac21-563490659fcd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.771901 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.773049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.773510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.773953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.788172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.789870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:35.814558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:35.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:35.816378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:35.816378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:35.816378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:35.816378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:35.817973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/716] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:35.823587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.852003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb7c1b-27d5-4185-a2e9-9a7c0d4a3040 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.899241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.900465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.901614 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.902139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.905339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.914807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:35.924366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:35.925553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:35.926416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:35.933194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 365/717] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:35.934414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:35.944638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0264ad-d791-404e-a5d4-5bdfef86831e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:35.969805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:35.982439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:35.983110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:35.983397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:35.983675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:35.984387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:35.984722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:35.986095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:35.991162 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/718] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:35.991979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.056809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c0d8f-8cf2-49e0-ad25-323ffa82cccf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.097731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.099017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.099523 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.100000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.101054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:36.101728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.103483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ab81f-6c4d-4dcd-85fa-71bdd384fd3b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.109406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7399-5169-4d87-9369-aa7e9be63363 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.118427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 366/719] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:36.124551 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cd37-2a58-4d29-a571-2242c098f7b6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.125232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cd37-2a58-4d29-a571-2242c098f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.125725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022cd37-2a58-4d29-a571-2242c098f7b6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.127350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 367/720] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:36.128526 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022cd37-2a58-4d29-a571-2242c098f7b6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.147027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.147754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.148039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.148319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.149327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:36.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.150865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1d1e-7dbe-43b3-8ca6-958b23dfebf6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.161502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/721] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:36.166189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.166189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.166189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.184148 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:36.184963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:36.202904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.233098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.261841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/722] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:36.263083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.265506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022cd37-2a58-4d29-a571-2242c098f7b6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.328717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.330545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.330824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.331092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.342418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.344751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:36.363816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:36.364794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:36.365691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:36.368417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 368/723] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:36.369514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.392397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ba4d6-22b8-439c-9686-8e8eafb35442 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.428539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.429483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.429875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.430243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.441281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.442851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:36.461518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:36.462481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:36.463430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:36.463430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:36.463430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:36.463430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:36.467641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/724] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:36.468704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.489030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb0bf-d325-4d76-a995-07d5f801481b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.503522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.509975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.529162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.530240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.530826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.531311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.532270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.533882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.576161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae5e51-2f91-4f1c-ba9a-1f9fdb2b197f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.609573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.610243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.610516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.610801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.611902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:36.611902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.613344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a6670-8b34-4504-b9b8-20ae173b4f75 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.621466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 369/725] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:45:36 2022] POST /identity/v3/services => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:36.628370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.633735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/726] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:36.634984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d715-e29c-409f-a98b-4fe7f9ec64ad None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.635314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d715-e29c-409f-a98b-4fe7f9ec64ad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.635634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21d715-e29c-409f-a98b-4fe7f9ec64ad None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.640782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/727] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:36.640782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d715-e29c-409f-a98b-4fe7f9ec64ad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.768994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.788342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004e787-c6ef-4e80-8fe3-347e20c51df9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.796335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21d715-e29c-409f-a98b-4fe7f9ec64ad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:36.837059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.837734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.838023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.838302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.840037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:36.840383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.841779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.843239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:36.843463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.843747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.844560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.845035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:36.845348 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:36.846876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153f98a0-62df-45c3-b93e-1a3824e1376a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:36.855482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/728] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:36.855656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:36.856049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:36.856335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:36.857749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 370/729] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:36.864285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:36.881208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:36.881777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:36.949140 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:36.995585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/730] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:37.033415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.069887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61cd2c-8edf-4386-83ce-4e7f378fb37d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.121394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.122213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.122499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.122777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.131669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:37.133289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:37.149994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:37.151097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:37.152089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:37.156116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 371/731] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:45:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:37.157385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.230823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:37.257356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4843fb-a47c-48aa-946e-8fbbb4c52f3a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.264246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc6e4-7e6b-4ea5-9012-2a09603e766a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.273031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:37.304124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.304836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.305121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.305496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.306336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:37.306641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:37.308916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:37.330283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.331092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.331377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.331654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.334930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 372/732] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:37.336407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.354954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:37.371655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:37.372736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:37.373594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/733] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:37.380497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.441671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125944fb-5fe6-4f14-9db5-2b22b6b79295 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.476865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.477512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.477800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.478078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.505883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:37.553327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:37.554891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:37.628466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ae7b1-eb98-4462-99db-2d4baf03e376 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.676869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.677530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.677809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.678081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.678823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:37.679124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:37.680483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:37.691106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/734] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:37.696342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.701449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:37.779164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 373/735] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:37.784797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:37.868474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:37.882856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd2f5-670e-4c49-993f-9cacf5fe5423 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.952267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:37.953154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:37.953433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:37.953705 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:37.965931 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40761932-8aba-424e-8e6a-71c84480fb6c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:37.976688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:37.978153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.004369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.005203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.005488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.005762 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:38.010930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:38.013060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:38.015155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:38.015155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:38.015155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:38.015155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:38.020644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.020644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.021277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/736] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:38.023241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:38.036578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:38.037580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:38.038469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:38.038469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:38.038469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:38.038469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:38.044494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 374/737] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:38.044494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.148967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6c0a7-6216-41d0-b9da-4cab8ca89b74 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.157115 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.162504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.185351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.186168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.186558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.186931 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.187778 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:38.188186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.189794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.206828 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 375/738] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:38.208088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.263224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8acd44-faea-47c0-a28b-ff1caaa60521 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.312214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd498303-f300-4686-b36d-3829680f1ccc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.331374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.332095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.332382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.332697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.333475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:38.333782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.335189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.346821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.347638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.347921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.348193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.356357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.358113 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.360058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/739] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:38.365677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:38.379401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:38.380366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:38.381299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:38.385515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 376/740] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:38.387002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.413056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.500419 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872b7c-673a-4171-959a-6e605a09fa67 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.523071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f90c06-f1a1-48b8-b643-44f8d5fedba6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.537665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.538298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.538600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.538864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.539646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:38.539959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.542040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9d4ec-5dd3-4ad1-a6b2-5bc1ef6687e5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.543209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.560112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 377/741] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:38.560112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f338-474c-4d44-b4c7-7ab3dad0a92c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.560112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f338-474c-4d44-b4c7-7ab3dad0a92c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.560112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f338-474c-4d44-b4c7-7ab3dad0a92c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.564144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 378/742] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:38.565133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.565440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.565734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.575461 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.576668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.577184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.577650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.584375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:38.585634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:38.586907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.589813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:38.612455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:38.613466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:38.614382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:38.617528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/743] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:38.619215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.676849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 379/744] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 10 12:45:38.677975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.702618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.745277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb172cd-bc6a-4616-b8c2-77c0f21ae430 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.784654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.785655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.786208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.786686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.787827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=40b5c686224c477d907c4060565b8eb1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:38.788363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.790205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.798167 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/745] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/role_assignments?user.id=40b5c686224c477d907c4060565b8eb1&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:38.799235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:38.832920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bcd7b-5206-4bf8-be98-bd2fe0013e86 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:38.887464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:38.913304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:38.914754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:38.915244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:38.915727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:38.917162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:38.918021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:38.920270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:38.954911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 380/746] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:38.956503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.013499 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3b782-3904-4926-ba48-2c2866c3e1e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.057032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.059134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.059631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.060125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.061137 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.062768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251298fd-6fc8-4eaa-baeb-8712367c0b2d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.063302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.094912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803df9d-16d8-4ba5-b055-2c5d7ed26040 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.135468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.136856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.137368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.137848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.156398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/747] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:45:38 2022] POST /identity/v3/services => generated 240 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:39.244775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee176-7677-4b12-8c69-01884262c125 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.245159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee176-7677-4b12-8c69-01884262c125 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.245535 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee176-7677-4b12-8c69-01884262c125 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.251341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/748] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:39.254235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76a8d-472e-4726-b356-bf57a5860bd9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.254235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76a8d-472e-4726-b356-bf57a5860bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.254235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a76a8d-472e-4726-b356-bf57a5860bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.257917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.259670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.280890 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d0a76a8d-472e-4726-b356-bf57a5860bd9 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:39.282261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d0a76a8d-472e-4726-b356-bf57a5860bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:39.344191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.374325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/749] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:39.376732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e3f6-cb12-435a-83d9-6b5d523fb3a7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.376732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e3f6-cb12-435a-83d9-6b5d523fb3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.377013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e3f6-cb12-435a-83d9-6b5d523fb3a7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.380757 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/750] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:39.390413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.390737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.390949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.402044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 381/751] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 10 12:45:39.402926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.414360 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:39.415611 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:39.438374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.512427 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/752] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:39.513684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.527224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4d07f-97f2-4786-83a4-5b3280b84405 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.577716 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.578510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.578791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.579296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.594805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:39.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:39.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:39.607492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 382/753] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:39.608214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.649417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.659056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a525fb-be9a-476a-b4c4-52db6df1f89e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.703929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.704929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.705312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.705681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.717480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.719088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.724705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b6d3-ed52-438d-ba40-8efeb8e66443 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:39.737630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:39.738555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:39.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:39.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:39.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:39.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:39.739604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/754] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:39.740367 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.749850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.765749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.766270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.766552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.766822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.767518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.769131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:39.792698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:39.793754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:39.795003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 383/755] 10.222.0.10 () {56 vars in 1129 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:39.795961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.872717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b548c3f-1eba-4600-a1fb-df9a880d39ae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.904879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:39.915580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e31c4-a082-4d41-a8a2-735824094d31 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:39.919541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.920200 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.923848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.923848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:39.923848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.923848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.936821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/756] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:39.937740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:39.962391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:39.963054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:39.963877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:39.964138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:39.965043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:39.965348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:39.966730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:39.978710 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 384/757] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:39.979687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.025627 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.074962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f1d90-5908-4404-8d4d-3a5f088b238b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.093555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c47d8-bff0-4a18-8e85-651b41ba5c90 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.130267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.130697 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.131530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.131770 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.131874 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.132069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.132652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.133130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.134304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.135792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.137395 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.143514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.144174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/758] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.145201 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.149536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:40.168187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:40.169152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:40.170337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:40.170337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:40.170337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:40.170337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:40.170337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 385/759] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:40.174964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.184433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.277533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815007a-3f61-49c5-8846-e64bb4dc9dfe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.279462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90395b57-6981-46e7-b137-87e5836ed509 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.315625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.320864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.321576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.321945 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.325566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.325566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.325566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.325566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.327435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.328882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.329352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.330051 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.336426 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 386/760] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.337441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.337950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.339879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:40.361069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:40.361979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:40.362862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:40.365408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/761] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:40.366322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.420217 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.466675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71521-ee6f-4c5a-a99d-9eaea5b02d1c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.487996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f188c-5846-45e9-8c46-97e160f7a56c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.504611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.505637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.506165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.506671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.507537 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.508016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.509635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.524191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.524792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.525007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 387/762] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.525110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.525305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.526193 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] RBAC: Adding query filter params (interface=public, service_id=2b494a1e6295435aada3a7717186b8dc, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.526536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.526919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.527994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.535927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/763] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/endpoints?service_id=2b494a1e6295435aada3a7717186b8dc&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.536871 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.594288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.642960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6df573-b62b-46e8-be98-2ce9022f7492 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.649199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0372e9-a7bf-45b7-9816-777b3a79b37b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.676996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.677788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.678071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.678350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.683342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.686761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.688205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.691268 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.691524 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.691990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.692384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.693349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.693805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.695344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:40.702971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:40.704058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:40.705401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/764] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:40.706624 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.711576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 388/765] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.712485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.811185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec191e-565c-4c19-9d42-ebc894b7896f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.823193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798b901-a13d-4a16-b7cd-e80844470f6b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:40.827977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:40.845817 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.846625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.846749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.847028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.847717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.849126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.855511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/766] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.856218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.864507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:40.865657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:40.866172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:40.866601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:40.867689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:40.868260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:40.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:40.891779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 389/767] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:40.902081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:40.967947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa09e6c-2ac9-41eb-919f-5d6c58b4501e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.006130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.006807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.007091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.007369 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.008318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=0042ad86624e4eb08844d9112381820e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:41.008683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.010200 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c1fdb-930f-4d10-a504-c5f12dd84e91 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.016656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/768] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/role_assignments?user.id=0042ad86624e4eb08844d9112381820e&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:41.071940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.127729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5a87-3630-4902-bea0-7390bd009e0d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.138256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca981-1a0c-4602-86ac-670928362a24 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.138554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca981-1a0c-4602-86ac-670928362a24 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.138838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca981-1a0c-4602-86ac-670928362a24 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.140504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/769] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:41.146797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.147431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.147915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.168127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:41.170107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:41.229199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.260262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/770] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:41.284075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.313092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.316394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.316947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.317605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.339135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.341572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:41.359980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:41.360924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:41.361813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:41.361813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:41.361813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:41.361813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:41.364088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 390/771] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:41.378708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.469338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e90e-d08f-45a2-b3be-5dacc6dade29 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.548425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.549311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.549599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.549880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.557637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9c447-5247-4a0a-a282-326bb3c730e4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.560951 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.574687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fcd82a35-cef1-48ce-a6ce-9428c83ae3c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:41.582821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:41.583949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:41.584898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:41.594108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/772] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:41.594108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7ffd-f6d6-42b8-bff2-025cf606475d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.594108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7ffd-f6d6-42b8-bff2-025cf606475d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.594730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e7ffd-f6d6-42b8-bff2-025cf606475d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.596651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/773] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:41.597801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7ffd-f6d6-42b8-bff2-025cf606475d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.624706 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.625640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.626107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.626655 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.627536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:41.628014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.629590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facd3ba-d3da-47ed-a17d-d093097b8f70 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.640923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.644092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 391/774] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:41.645430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.645719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.645996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.663255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:41.664432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:41.726633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e7ffd-f6d6-42b8-bff2-025cf606475d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.758862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 392/775] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:41.760865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.780116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.780730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.781017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.781295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.782063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:41.782352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.783720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.793265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/776] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:41.793987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.882750 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.895012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dcc32-28ab-437e-b21c-e0e4982d2933 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.926917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:41.935839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7479f5-4704-4881-9854-58fa9751ffff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:41.939469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.940267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.940552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.940859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.950221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.952024 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:41.970491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:41.971553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 393/777] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:41.972809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:41.980211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:41.981537 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:41.981985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:41.982913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:41.983717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:41.985646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:41.999476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:42.000448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:42.001885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/778] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:42.002749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.085990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e9400-af80-4202-ae74-ce9b0a83a098 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.105560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c902f-3b16-4a30-89ef-d532bee1025a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.123867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.124992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.125475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.126086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.137442 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.139561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.140594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.141282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.141740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.142025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.142871 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:42.143180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.144652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.158094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/779] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:42.158930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:42.161747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:42.162837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:42.163728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:42.163728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:42.163728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:42.163728 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:42.170519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 394/780] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:42.171579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.174510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.185047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.267293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334649e-34d1-44c8-9b5f-0612d8e02738 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.282516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a3e3a-e051-41e3-a76d-73a66c5ed263 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.303930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.304586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.304931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.305211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.305918 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:42.306243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.307706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.313096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/781] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:42.314081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.322233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.324026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.324512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.325005 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.327219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=b91f8654801b49689bb5774097b59bb5, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.328978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.403141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.417378 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 395/782] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:42 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:42.418704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.420272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664963e-98cf-48ad-a76f-ded1ef9c76c7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.457035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.461210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.473493 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/783] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:42.483937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.540570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.591296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129753f-3f12-4708-9f0d-c0880c05cfba None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.635978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.637138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.637631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.638107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.639079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] RBAC: Adding query filter params (type=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:42.639741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.641663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.648516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 396/784] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:42.656754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.707741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b96264-df6d-46d8-a577-de140ade8781 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.745200 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.746109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.746499 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.746769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.754936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.756393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:42.771902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:42.772944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:42.773869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:42.776946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/785] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:42.780049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.785037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.786406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055177e-7e0c-4ade-a85b-68ec9d02eb7c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:42.829922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:42.847826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:42.848493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:42.848796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:42.849069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:42.854006 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] RBAC: Adding query filter params (interface=public, service_id=8109f31f27984e12a33d429cc0a0ef4d, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:42.854442 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:42.855875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:42.875458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 397/786] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/endpoints?service_id=8109f31f27984e12a33d429cc0a0ef4d&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:42.881081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:42.942834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155645d-272d-4623-8bb7-3963047b10b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.021677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.023081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.023569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.024021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.037399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:43.037987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.039642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60bf5be-5b3a-4a8c-aefe-f33652b38105 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.074639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279e17d-d7a4-4cb7-b661-7427263ab3f3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.120663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.120663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.120663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.120663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.121501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.121501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.132651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 398/787] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:43.212858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/788] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:45:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:43.218328 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.319248 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27476f-971c-4238-915c-5c8f80a16723 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.319551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27476f-971c-4238-915c-5c8f80a16723 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.319723 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27476f-971c-4238-915c-5c8f80a16723 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.321510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/789] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:43.327726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.328050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.328298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.334727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:43.347707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:43.349114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:43.397880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789a04-4940-4a87-9ba6-18252bc89e43 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.448552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.449380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.450830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.450830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.455235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:43.468184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.469397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/790] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:43.470139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:43.489844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:43.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:43.491777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:43.491777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:43.491777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:43.491777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:43.494114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 399/791] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:43.500058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.504212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.631441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50da65e-271c-43ef-b738-7c973be4c801 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.639513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:43.646960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08bc10-7f84-4fad-b642-2702abd2c00a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.670448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.671777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.672536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.672935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.673690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.675200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8c96c5c9-1a8b-455f-ba4a-99ac56eb9b07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:43.688464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:43.689633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 10 12:45:43.690663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:43.697212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 400/792] 10.222.0.10 () {56 vars in 1129 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:43.697212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71883f-b389-4e2e-b299-177d073d5f79 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.697212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71883f-b389-4e2e-b299-177d073d5f79 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.697212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71883f-b389-4e2e-b299-177d073d5f79 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.700153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.700824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 401/793] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:43.701586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.701696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71883f-b389-4e2e-b299-177d073d5f79 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.702347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.702804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.703714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:43.704195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.707188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ad31c-4d0c-4484-ab39-d091ffd48042 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.724305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/794] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:43.726685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.727182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.727636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.751287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:43.752873 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:43.803987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:43.832795 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/795] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:43.834128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.847146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71883f-b389-4e2e-b299-177d073d5f79 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:43.896701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:43.897821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:43.898189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:43.898580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:43.899718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:43.900104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:43.902623 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:43.909828 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 402/796] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:43.911590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:43.959888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:43.972868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a12d20-d170-40e6-9c6e-e32cfb954b88 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.011085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.012226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.012760 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.013239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.020915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.022693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:44.040270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:44.041256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:44.042866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:44.044386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2c3ed-8f1a-4740-b1b4-8d373464fa7d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.045903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/797] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:44.047128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.091415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.092253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.092540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.092846 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.098489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:44.108532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:44.118647 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:44.120330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:44.121765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:44.124680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 403/798] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:44.125734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.171238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895238-a003-4857-9a00-b8a8f682a767 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.207983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.209154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.209647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.210119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.211016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:44.211565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.213155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.219623 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/799] 10.222.0.10 () {56 vars in 1124 bytes} [Fri Jun 10 12:45:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:44.226413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.252073 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:44.259947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbeaff-5cab-4f84-90f2-dcaa91eeef64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.298803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.299815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.300300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.300825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.301822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:44.302347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.303963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.317529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 404/800] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:44.318666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.358874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db8667-f168-488e-a555-2fa2f0e19b3b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.368066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:44.406563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.407283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.407570 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.407845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.408776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:44.409087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.411015 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.429603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/801] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:44.430603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.443866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef064aca-fcac-4b78-b71d-63a7214d9e4a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.481829 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.482854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.483355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.483837 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.484836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.486483 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.550829 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d13fe8-cbf3-422f-b279-8198001a7ee9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.583481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 405/802] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:45:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:44.584308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.624818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:44.629821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.630728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.631012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.637228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/40b5c686224c477d907c4060565b8eb1/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.664252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=40b5c686224c477d907c4060565b8eb1, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.666012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.734173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/803] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:44 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/40b5c686224c477d907c4060565b8eb1/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:44.768714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488f13-cdef-4ee7-b797-75114bebdc59 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.815388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:44.816110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.816390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.816686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.829215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:44.830788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-31511ed3-49bf-4eea-beac-99be8f1cea18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:44.850238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:44.851208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:44.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:44.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:44.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:44.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:44.852112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 406/804] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:44.857956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:44.879933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:44.976015 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006c85-475d-4a27-8d0a-99f5f7b91c38 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.976468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006c85-475d-4a27-8d0a-99f5f7b91c38 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.976800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5006c85-475d-4a27-8d0a-99f5f7b91c38 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:44.978784 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 407/805] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:44.980301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c835db1-6be9-492a-8348-2e46b450b823 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:44.985131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:44.985421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:44.985696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.007231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:45.008570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:45.024007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.025539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.026576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.027052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.027980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:45.028520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.030273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.044267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/806] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:45.053936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.083660 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.108714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 408/807] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:45.158747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.174375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.231773 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7656-0b88-474f-8c81-cb4d364211c2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.275562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.276716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.277028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.277303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.285394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.286833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:45.302590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:45.303583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:45.304532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:45.307904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/808] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:45.310397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.349628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bea11-a0a5-4ccb-b38e-9a87025e20f5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.412017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb1d2a-933d-4248-93f5-4a0bbaa5a4a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.438450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.439257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.439538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.439812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.459082 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.459775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.460055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.460323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.461224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:45.461527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.463030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.467182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.471823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:45.479825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:45.480907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:45.481754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:45.490439 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 409/809] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:45.495064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.512860 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/810] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:45.515893 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.573718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.624805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e03b4-3fbf-4c95-9a9a-2ebb7c84f3af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.638226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfa246e-2abf-47d9-8465-6645d9d8cfb1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.660221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.661041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.661379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.661779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.672606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.674268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.675713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.676652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.677152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.677573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.678461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:45.678914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.680589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb1ba3-fb7c-483c-8b2e-a0f31dd24985 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:45.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:45.695616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:45.696729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:45.696729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:45.696729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:45.696729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:45.697012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 410/812] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:45.699288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48b0-adc0-44c1-bdb2-d85b2797ec20 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.699423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/812] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:45.699824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48b0-adc0-44c1-bdb2-d85b2797ec20 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.700229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc48b0-adc0-44c1-bdb2-d85b2797ec20 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.700324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.702559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 411/813] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:45.704488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc48b0-adc0-44c1-bdb2-d85b2797ec20 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.749580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.805624 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e862f4f-ae32-4f10-9a76-81523e58a672 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.816818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc48b0-adc0-44c1-bdb2-d85b2797ec20 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:45.842127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.842968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.843238 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.843562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.849043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.854564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.856057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.857584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:45.858569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.859080 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.859536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.860443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:45.860955 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:45.862477 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77968b-793b-49ea-81fa-25cf3bcabf91 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:45.875209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:45.876108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:45.877014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:45.877014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:45.877014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:45.877014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:45.878959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 412/815] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:45.880462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:45.880947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:45.881216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/815] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:45.881603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:45.883388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.902272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:45.903937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:45.977145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 413/816] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:45.978297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:45.985704 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:45.991580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7c016-2b52-40ca-b2b3-58627fadbca8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.030132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.030764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.030961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.031172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.031901 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:46.032221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.033657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.050701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/817] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:46.051735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.095521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3d7cc-ef66-4659-ab8d-427aea71187c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.098385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.134354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.136135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.136649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.144884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.146563 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.157982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e450-54b2-4ec7-a6c2-5cfab8e4adc6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:46.162888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:46.164172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:46.165284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:46.167842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 414/818] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:46.168964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.200401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.201297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.201582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.201849 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] PATH_INFO: `/v3/services/network` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.202554 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.203957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:46.217046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:46.218300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:46.219237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/819] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:46.220018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.244504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.287100 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4c72e-c2c9-4a8d-8e3c-5b5e37e2a1ce None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.326979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80d96e-b030-4807-b42d-0e965de89275 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.327491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.328538 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.329014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.329496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.337818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.339802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:46.357236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:46.358379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:45:46.359334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:46.361747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 415/820] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:46.362642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.367388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.368106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.368439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.368753 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.369604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:46.369922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.371341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.388834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/821] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:46.389701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.393923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.476873 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabfb3a-e684-4b3d-a13a-ffe8ce2dab2a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.477412 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.498157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace646a3-ed6c-4095-acbe-01b98ac30801 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.516783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.517798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.518245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.518715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.519563 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] RBAC: Adding query filter params (name=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:46.520027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.521654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.526960 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 416/822] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:46.528018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.536534 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.537510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.537642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.537882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.538711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:46.539014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.540666 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.565739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/823] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:46.566804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.632455 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.645964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ea4d-6d3e-4ea0-ab06-88a8251692ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.677754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed27ca-c51d-4fc3-986e-4479f62d0c35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.690333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.692515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.692690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.693632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/0042ad86624e4eb08844d9112381820e/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.697188 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=0042ad86624e4eb08844d9112381820e, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.699456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.727322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:46.727986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:46.728270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:46.728548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:46.729877 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:46.730214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:46.731572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:46.741219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/824] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:46.741219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.743885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:46.781009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 417/825] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:46 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/0042ad86624e4eb08844d9112381820e/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:46.782099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:46.959711 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ac69b-f581-462a-95da-b883a180d4a1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:46.973545 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d3336-83ee-4f79-a1ab-5ae63a357867 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.010891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.011475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.011760 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.012032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.018649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.019593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.020072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.020554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.021515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.023691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346f5f8-40bd-440d-9baf-958c3c8bcf0e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.099119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.101556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d9592-b5dd-468d-9cc3-e64f8e27f421 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.103958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.133688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 418/826] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:45:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:47.134449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6a83-18dd-46a6-bc0a-86de6715f65c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.134621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6a83-18dd-46a6-bc0a-86de6715f65c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.135724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e6a83-18dd-46a6-bc0a-86de6715f65c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.138963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 419/827] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:47.145126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.145428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.145690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.158742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.182972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:47.184261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:47.331785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/828] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:45:47.331785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2272-a7b7-4631-94bc-82d7b70b869b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.331785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2272-a7b7-4631-94bc-82d7b70b869b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.331785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f2272-a7b7-4631-94bc-82d7b70b869b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.334617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/829] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:47.336766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.336766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.336766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 420/830] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:47.341471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.354174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:47.355387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:47.441921 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/831] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:47.442588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.468499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d358b-2d33-42a3-bc9b-83c8a3722d37 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.483200 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.500331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.508284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.511757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.522533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.528905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:47.542638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:47.543737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:47.544973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:47.544973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:47.544973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:47.544973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:47.544973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 421/832] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:47.545264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.574427 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da2f0-d646-4402-a27c-61ea7d9d0bb5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.617280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.617830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.618002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.618282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.628612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:47.636864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:47.637904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:47.638717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/833] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:47.639395 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.669369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ced18-7552-440f-9a33-477bf7de1973 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.705436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.706165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.706448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.706724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.707377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.708879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:47.721056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:47.722051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:47.722888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:47.727720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 422/834] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:47.729509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.742261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.751723 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb89dc-61f4-47a8-a93a-cedd1e9df943 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.779891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.786060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.786723 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.787008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.787287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.788006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:47.788315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.789721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.802191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/835] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:47.802830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.841852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f81f3-5ab4-4bb0-840d-fe86cf0b634a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.877103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.877688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.877979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.878255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.878995 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:47.879302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.880685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.889692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 423/836] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:47.890557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.916942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e92e6-bc5d-4dd5-a0c6-9d755a732ae4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:47.952702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:47.953687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:47.954174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:47.954655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:47.955536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:47.956032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:47.957480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:47.962598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/837] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:47.963730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:47.986154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:47.999482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebaa8e-557b-4467-8661-3f8a8630d543 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.009129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:48.035941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.036761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.037040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.037319 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.046369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.048915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:48.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:48.065427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:48.066316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 424/838] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:48.066810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.077479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfd349-1b45-46a5-b610-2448515cfc3d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.113498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.114314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.114562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.114836 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.124979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.126411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:48.144261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:48.145211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/839] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:48.146693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.177139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4250a6-d6aa-49f7-bfac-4d3d37a98891 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.213008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.214502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.214780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.215211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.215910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:48.216214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.217666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.219531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:48.232644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 425/840] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:48.232644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.267658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:48.278776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2c2d8-7d25-466e-a78d-44d081ea071a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.323991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.324865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.325243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.325613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.326592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:48.327697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.330055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.348784 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/841] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:48.352526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.365122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97805830-2046-4c2c-9907-92920475eb83 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.406046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.406696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.406986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.407270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.408129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:48.409092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.410446 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.425511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 426/842] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:48.430705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.485502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8999f-3ca2-4e26-985d-b87e8a9f648a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.514603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:48.522899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.540680 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.541139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/843] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:48.549739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:48.560891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c2329-d6f0-46cc-8d35-130cb4e62bf2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.599850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.600715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.601002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.601279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.622181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.623665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:48.639904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:48.640977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:48.642305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 427/844] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:48.647697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.761824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6637cd-f1d6-4ed5-8dbe-8840e0516bb4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.796539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.797549 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.798039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.798490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.799504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:48.799993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:48.801617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bcf2cc-19b4-4fad-8b5b-af2b683c99d0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:48.820401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/845] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:48.826414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:48.933655 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c167f1a-6661-4b8a-85ec-b24fdc78ba10 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:48.973629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:48.974277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:48.974559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:48.974831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:48.998430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.048731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.050219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.115686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8da2-1435-4e63-961c-d01ac8fc5bcb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.116230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8da2-1435-4e63-961c-d01ac8fc5bcb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.116230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e8da2-1435-4e63-961c-d01ac8fc5bcb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.117855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/846] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:49.123398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.123691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.123972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.141528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:49.142733 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:49.156902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 428/847] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:45:49.169881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.196602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.224359 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.232727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/848] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:49.248516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.274002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a3dae-8a6a-4989-b948-98198ccda8f2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.321660 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.323563 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.324055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.324673 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.340158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.342710 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:49.366098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:49.367059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:49.367966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:49.367966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:49.367966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:49.367966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:49.367966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 429/849] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:49.373434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276073ad-8519-4e8a-97c9-65993ca2d465 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.375229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.422373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.423965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.424783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.425275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.440670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:49.451099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:49.452033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:45:49.452939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:49.458891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/850] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:49.459785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.499657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11d5be-5090-48ba-be52-435a6ac53aee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.503323 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.509125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.540102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.540809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.541101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.542085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.543235 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:49.543549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.545274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.562160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 430/851] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:49.563181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.592710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c791df45-432b-495c-bd90-4ef936b18d97 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.643633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.644540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.644841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.645124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.645949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:49.646260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.647807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.663445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/852] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:49.664596 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.704924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d92ff-9816-436b-a56e-ec3afd0399ba None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.743715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.745477 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.746143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.746552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.755262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.756935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:49.772418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:49.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:49.774693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:49.781857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 431/853] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:49.782498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.811611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.819322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad8488-75f8-419b-962f-8fa97d192819 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.822065 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:49.863907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.865062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.865591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.866591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.883195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.886604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.895265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205c58a-b5e3-463e-9928-289df3d26fee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:49.913403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:49.914346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:49.915241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:49.915241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:49.915241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:49.915241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:49.918673 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/854] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:49.924777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:49.950878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:49.952100 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:49.952678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:49.953269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:49.954521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:49.955075 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:49.957811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:49.984721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 432/855] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:49.987601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.062452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168d2c3-2c35-4f2e-8750-107ea0d38b46 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.078179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.095291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843bfb6-f2ca-49b9-88ec-a746e22c7142 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.108940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.110253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.110539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.110814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.111830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:50.112143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.113530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.131190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/856] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:50.131996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.144477 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.145885 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.146379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.147103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.148405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=40b5c686224c477d907c4060565b8eb1) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:50.148961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.149873 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.152772 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.161167 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 433/857] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:49 2022] GET /identity/v3/role_assignments?user.id=40b5c686224c477d907c4060565b8eb1&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:50.247184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17877e-6cfd-44da-b281-e63db1fae9aa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.286670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.287791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.288260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.288757 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.298644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.300422 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:50.316698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:50.317720 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 10 12:45:50.318652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:50.321030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/858] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:45:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:50.329772 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.444714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171160-6345-4920-96bc-91a14e5deef9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.493414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.494113 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.494401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.494691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.495969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:50.496291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.497812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8212d-a79c-4e65-ae92-3ea9ac3cb6d6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.518929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 434/859] 10.222.0.10 () {56 vars in 1135 bytes} [Fri Jun 10 12:45:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:50.524541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.545082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd8a8-2c8c-41e1-ae3e-842a59e005c2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.545409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd8a8-2c8c-41e1-ae3e-842a59e005c2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.545652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bd8a8-2c8c-41e1-ae3e-842a59e005c2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.547281 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 435/860] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:50.552077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.552609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.553110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.564546 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.571435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:50.573729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:50.624991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.631643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddf012-995d-4b78-bf86-ce1f7fa91a04 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.657974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 436/861] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:50.676379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.677401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.677965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.678442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.682309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.754957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.756019 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813a8f3-f207-4bcd-b68f-e2bf30804374 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.804364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294034fd-41f2-44da-8560-ee969f3d0031 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:50.841664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.845877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:50.846788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.847339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.847932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.848868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:50.850415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96f303-ba4c-4067-8c2d-cfff5b7778cc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:50.854492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:50.870477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/862] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:45:50.872630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e61f-b33d-4ba2-b978-e7b2b11e683a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.873040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e61f-b33d-4ba2-b978-e7b2b11e683a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.873457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e61f-b33d-4ba2-b978-e7b2b11e683a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.878566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/863] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:50.879701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e61f-b33d-4ba2-b978-e7b2b11e683a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:50.936793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 437/864] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:45:50 2022] POST /identity/v3/services => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:45:50.939516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:50.940380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:50.940845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:50.966203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:50.968487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:51.008213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e61f-b33d-4ba2-b978-e7b2b11e683a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.049598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.050484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.050766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.051039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.064159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.065965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.071475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 438/865] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:51.089576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:51.090869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:51.091982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:51.091982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:51.091982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:51.091982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:51.091982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/866] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:51.096968 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.101998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.131294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:51.215215 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1bbb6d-0903-406f-be23-c45465f8ffd8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.223998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d558bae-826d-45d0-9cd8-116e417ba613 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.243154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:51.252924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.253821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.254105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.254378 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.255029 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.256779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.265616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.266202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.266484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.266759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.267481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:51.267789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.269186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:51.270503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:51.271420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:51.272280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 439/867] 10.222.0.10 () {56 vars in 1132 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:51.278357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.286676 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/868] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:51.293861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.396056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:51.408968 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd45f8-c6b5-470b-97cb-75ff36a8d2a3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.422664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924a249-b2a6-4889-ad44-49ad396b61b8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.458646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.459624 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.459846 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.460304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.460597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.460974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.461078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.461316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.462131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:51.462635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.465207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.469494 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.471024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.476078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 440/869] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:51.477679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:51.490122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:51.491074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:51.491965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:51.496311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/870] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:51.497642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.555644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:51.607953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f44d4-9cd2-4b6a-8c62-8a2483f0a3e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.629372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca620e4-ef12-4e02-8e77-db172d6426ad None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.656381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.657077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.657363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.657880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.658678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:51.659464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.661197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.667932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.669025 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.669783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.670253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.671147 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:51.671648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.673230 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475210-5a8b-4294-8197-e878ed528f5f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.676662 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/871] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:51.682813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:51.688658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 441/872] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:51.698796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:51.800608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7905c-0ed5-43cb-b34f-98270f7b3cd8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:51.836877 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:51.837453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:51.837732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:51.838003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:51.839376 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=0042ad86624e4eb08844d9112381820e) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:51.839778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:51.841385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e3234-869a-48db-93d9-0cdfb91058a1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:51.852940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/873] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:51 2022] GET /identity/v3/role_assignments?user.id=0042ad86624e4eb08844d9112381820e&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:52.463764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4133c-b59d-48ef-b807-79b271026b5e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:52.464399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4133c-b59d-48ef-b807-79b271026b5e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:52.464572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4133c-b59d-48ef-b807-79b271026b5e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:52.466133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 442/874] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:52.471253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:52.472100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:52.472584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:52.489819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:52.491380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:52.554796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:52.563441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/875] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:52.586983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4133c-b59d-48ef-b807-79b271026b5e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:52.702815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4133c-b59d-48ef-b807-79b271026b5e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:52.721027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:52.738599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:52.739408 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:52.739694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:52.739973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:52.751437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:52.759344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:52.760436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:52.761356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 443/876] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:45:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:52.768497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:52.871593 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863335bb-b913-4433-b347-9b13d25c2c9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:52.909306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:52.909975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:52.910263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:52.910544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:52.911299 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:52.911611 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:52.913017 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:52.922571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/877] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:45:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:52.927970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.031209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781fef1-be64-4f6f-8131-69d4eedfbcd6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.066000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.067138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.067646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.068135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.079363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.081119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-08575d6a-5cb6-41e1-8d42-47b97b830c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:53.102894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:53.104422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:53.105339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:53.105339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:53.105339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:53.105339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:53.107649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 444/878] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:53.113340 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.183417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.218521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea3b7-5071-4d86-8af8-203c0e273ae4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.218946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea3b7-5071-4d86-8af8-203c0e273ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.219325 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffea3b7-5071-4d86-8af8-203c0e273ae4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.221806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 445/879] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:53.226836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.227198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.227552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.228390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d4c9-c967-4471-998c-4399ec331c4c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.245395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:53.246670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:53.269355 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.270172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.270783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.271068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.272067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:53.272377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.274463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.276826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.293251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/880] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:53.295994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.333014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 446/881] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:53.355777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.418653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98111fc1-4cc1-480a-963e-eb0695e3660a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.441001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.461218 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6782c8-2c07-44ff-9249-9cd08bd3382f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.462525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.464273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.465644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.466145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.475512 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.478057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:53.498846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:53.500060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:53.501272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:53.502677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.503561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.504022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.504409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/882] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:53.509001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.509671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.509786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.512069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:53.525277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:53.526447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:53.527305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:53.532052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 447/883] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:53.533357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.561143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.629671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907064af-e5eb-4740-8074-5ac304045086 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.643113 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df468c-1b2b-4b6e-8b80-35e4cd72b55e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.669452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.670507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.670930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.671302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.672336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:53.672930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.674384 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.681560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.682751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.683238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.683707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.684605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:53.685165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.686751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.692162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 448/884] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:53.699375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.704093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/885] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:53.705402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.743644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.795345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:53.807502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7979-e542-4d26-9c9d-7f84bd8d29f3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.819938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfd5b5-8b6e-4b7f-8f41-5b849573b35a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.843357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.843974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.844265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.844546 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.845393 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:53.845605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.846974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.857161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 449/886] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:53.858119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:53.866765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:53.867699 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:53.868264 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:53.868793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:53.949221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:53.951228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcfbf8-0496-4989-a183-75a176cd2709 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:53.966992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62696f-34f8-4e7e-81dd-77ab4d28728b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:53.988857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.003458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.004120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.004409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.004723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.005521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] RBAC: Adding query filter params (interface=public, service_id=f990a2c1c1414f52be461dd0f1f6d578, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:54.005841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.007218 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036455ce-4cd1-4d35-89ee-ef975b6160ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.012682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 450/887] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/endpoints?service_id=f990a2c1c1414f52be461dd0f1f6d578&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:54.013933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dfa-7008-4f94-86da-bed845736fec None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.014222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dfa-7008-4f94-86da-bed845736fec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.014503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dfa-7008-4f94-86da-bed845736fec None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.019533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 451/888] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:54.019533 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84dfa-7008-4f94-86da-bed845736fec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.038609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.069323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/889] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:45:53 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 10 12:45:54.070692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.070912 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.071189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.090655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:54.091932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:54.134431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84dfa-7008-4f94-86da-bed845736fec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.156907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/890] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:54.157738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.172450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.173208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.173560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.173841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.174519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9daf86-93c1-4534-b42f-0f061a63155a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 452/891] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/services => generated 1011 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023507a-38eb-49b9-b45c-5b1cd7cc9714 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023507a-38eb-49b9-b45c-5b1cd7cc9714 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023507a-38eb-49b9-b45c-5b1cd7cc9714 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 453/892] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:54.192957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023507a-38eb-49b9-b45c-5b1cd7cc9714 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.231812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.272349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8192f9e-d487-4aa1-aabf-6dfabcf52606 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.283002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.304259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023507a-38eb-49b9-b45c-5b1cd7cc9714 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.311133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.311936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.312216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.312483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.324969 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.326363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.342848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.343518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.343805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.344092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.344844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-398f9687-3014-4497-bcab-8bb3a4a4a696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:54.345856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:54.346758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:54.347653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:54.347653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:54.347653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:54.347653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:54.347896 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.347974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/893] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:54.349173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.349173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.349173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.366602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:54.372201 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:54.434243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/894] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:54.435104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.448164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 454/895] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:45:54 2022] POST /identity/v3/services => generated 269 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:54.464996 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.516852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.593496 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e10bb-f71b-41f9-bcf5-dca1e08de32e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.612292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1269e3-4fc8-4fbf-8ced-516b69fc61e0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.645255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.646146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.646762 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.647035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.647911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:54.648275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.649758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.654807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.655616 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.655898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.656171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.656878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.658245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.661320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.665456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/896] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:54.671994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:54.691871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:54.693026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:54.693854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 455/897] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:54.694726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.804166 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecd883-f312-4ffd-b36f-48ac6feae2dc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.814866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffd13f-ff23-4b1c-9d02-bda427919e1c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:54.816453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:54.854943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.856524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.857090 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.857595 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.861047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:54.862045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:54.862326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:54.862599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:54.863305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:54.863608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.864994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.867648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:54.870199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:54.871411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 456/898] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:54.876567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:54.893239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:54.894202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:54.895115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:54.898317 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/899] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:54.904951 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:54.963080 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:55.013785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df7714-c656-4cbc-9f09-58f03aa5064e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:55.015385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8c8969-14ea-48e5-b146-e7afa46f4937 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:55.054741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:55.055414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:55.055699 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:55.056046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:55.057658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:55.057990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:55.059506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6f151-ee35-43f1-8bd6-35e666939981 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:55.060449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:55.061417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:55.061708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:55.062460 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:55.063200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:55.063515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:55.064979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:55.071544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 457/900] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:55.077501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/901] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:55.083093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:55.203554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ecf86-2934-4c48-941f-3cf1eaf9577f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:55.248644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:55.261138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:55.261816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:55.262101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:55.262380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:55.263225 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] RBAC: Adding query filter params (role.id=d5f1a17dc0f0417880f6b85cb2849267, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=40b5c686224c477d907c4060565b8eb1) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:55.263542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:55.265122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a343512-921b-4714-a31d-849c056ab15a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:55.273547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 458/902] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:45:55 2022] GET /identity/v3/role_assignments?user.id=40b5c686224c477d907c4060565b8eb1&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=d5f1a17dc0f0417880f6b85cb2849267 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:45:56.360297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2839-405c-45ed-93be-9bb20e0fc61f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.361251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2839-405c-45ed-93be-9bb20e0fc61f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.361686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c2839-405c-45ed-93be-9bb20e0fc61f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.363473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/903] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:56.369268 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.370136 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.370629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.388225 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:56.389756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:56.460723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 459/904] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:45:56.483381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c2839-405c-45ed-93be-9bb20e0fc61f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:56.514088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:56.589897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c2839-405c-45ed-93be-9bb20e0fc61f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:56.636067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:56.636953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.637235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.637508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.638160 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:56.639523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-584566f9-8de0-41d5-b029-1f3f61eda936 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:56.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:56.653253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:56.654651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/905] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:56.659207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:56.767414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed9866-33be-423d-9881-c3db3a0509b8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:56.779507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee5a-d1ee-4663-9cf4-2b6a9e4bef8b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.780128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee5a-d1ee-4663-9cf4-2b6a9e4bef8b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.780605 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7ee5a-d1ee-4663-9cf4-2b6a9e4bef8b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.782541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/906] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:45:56.787562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.788092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.788573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.792563 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:56.805125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:56.810196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.810196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.810196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.810196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:56.810196 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:56.810549 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:56.810549 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:56.810698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:56.814318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 460/907] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:56.821680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:56.892765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/908] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:56.907521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:56.932885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:56.945668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362799f-eeb5-4b33-b1f4-d2d7fa193971 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:56.990565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:56.991942 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:56.992662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:56.993098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:56.994698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:56.995152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:56.997451 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.008819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 461/909] 10.222.0.10 () {56 vars in 1114 bytes} [Fri Jun 10 12:45:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:57.010495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.020133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4e10a-35c6-4952-91de-4579cddd47dd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.058950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.060180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.060608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.061054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.061846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.063526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.074633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:57.078133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:57.079149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:45:57.080001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:57.087378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/910] 10.222.0.10 () {56 vars in 1132 bytes} [Fri Jun 10 12:45:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:57.089042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.140071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bb26b-33f5-4b25-afec-ccb1ca91b844 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.183816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.191523 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.192539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.192856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.193136 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.194028 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.196042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0dcde-72e8-45d1-ab34-054224a023b6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.200812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197c34-640a-4153-938f-f08c85b40c53 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.235021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.235736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.236020 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.236291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.237016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:57.237322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.238734 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.244062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/911] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:57.250062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.316566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 462/912] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:45:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:45:57.318078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edc4a-8fc6-40be-9e4f-09e8428a8cea None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.318367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edc4a-8fc6-40be-9e4f-09e8428a8cea None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.318651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edc4a-8fc6-40be-9e4f-09e8428a8cea None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.321617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 463/913] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:57.327157 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ce93-479f-4583-a22e-276b2a36f86e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.327451 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ce93-479f-4583-a22e-276b2a36f86e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.327831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ce93-479f-4583-a22e-276b2a36f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.345724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f721ce93-479f-4583-a22e-276b2a36f86e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:57.347082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f721ce93-479f-4583-a22e-276b2a36f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:57.378706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87229e8e-f485-4a02-87ad-4f71acc90719 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.436949 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 464/914] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:57.438696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1e49-bb45-4a42-aa20-5919ed974f89 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.438957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1e49-bb45-4a42-aa20-5919ed974f89 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.439238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b1e49-bb45-4a42-aa20-5919ed974f89 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.440497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.440659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 465/915] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:57.441551 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.442048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.442544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.443479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:57.443993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.445638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.446423 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.446713 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.446994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.457029 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/916] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:57.459198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.473319 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:57.474690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:57.474956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.505898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.556794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 466/917] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:57.558573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.575840 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d70a52-5b21-4ad4-a2c7-29a833ebbb51 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.618496 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.619226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.619542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.619818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.620627 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] RBAC: Adding query filter params (interface=public, service_id=9d937265f0dd465f904bc40c93176e3b, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:57.620966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.622332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.628660 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/918] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/endpoints?service_id=9d937265f0dd465f904bc40c93176e3b&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:57.628660 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.677341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ff184-d55e-4eba-9cfa-426e00ec561d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.707000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.712234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.713449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.713761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.714103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.714948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.716318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.734012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c6e67-a6fa-4710-aaf8-6add1fd106fd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.768282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.769120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.769407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.769682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.780203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:45:57.788416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:57.789498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:57.790332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/919] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:57.791071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.831021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 467/920] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:45:57 2022] POST /identity/v3/services => generated 241 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:45:57.832175 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:57.875384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.915471 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2586529-8f35-48f6-ac46-2f1cb171f235 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:57.957583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:57.964474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:57.968827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:57.968827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:57.968827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:57.968827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:57.968827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:57.975076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/921] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 12:45:57.989931 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37557c4-ae8e-4b76-a081-13a77b6cb52c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.033911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.034605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.034891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.035168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.035937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:58.036247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.037687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.048382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 468/922] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:45:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:58.054454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.168402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f77cb4-0466-4295-82f0-07fee99f52a6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.205063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.205858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.206139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.206410 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.217960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.219326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:58.237514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:58.238550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:58.239466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:58.239466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:58.239466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:58.239466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:58.239466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/923] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:58.244367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.334041 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:58.349980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca61d7-d2a7-4b7e-9ffa-0c29033ea8ab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.386493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.387076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.387357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.387633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.388362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:58.388693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.390070 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.402982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 469/924] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:58.408338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.458292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:58.517629 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8334dfa-3a16-411c-b7b0-982b21f1a2c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.551795 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.552674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.552960 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.553234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.562510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.564007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:45:58.579048 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:58.581329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:58.583561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/925] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:58.587357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.702589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827c04c-791d-4c7b-a060-fe16fb372ec3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.737357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c873b0-583f-4c34-846d-619581814686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.738026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c873b0-583f-4c34-846d-619581814686 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.738309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c873b0-583f-4c34-846d-619581814686 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.738634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c873b0-583f-4c34-846d-619581814686 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.739471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c873b0-583f-4c34-846d-619581814686 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:58.739780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c873b0-583f-4c34-846d-619581814686 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.741246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c873b0-583f-4c34-846d-619581814686 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.760558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 470/926] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:58.772594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.875553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b645ca3-2d5c-4f8a-b6e2-85468ca2fd73 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:58.883042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:58.909993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:58.911094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:58.911577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:58.912084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:58.923697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:58.925422 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:45:58.943078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:58.943985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:58.944930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:45:58.944930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:45:58.944930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:45:58.944930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:58.947075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/927] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:58.953337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c873b0-583f-4c34-846d-619581814686 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:58.956372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:59.055591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c873b0-583f-4c34-846d-619581814686 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:59.097264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:59.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.098217 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.098494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.099212 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:59.099518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:59.100913 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:59.113882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 471/928] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:59.119499 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:59.224435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f5c20-5b04-4ccd-a3d5-5e14f3536c17 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:59.260002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:59.261161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.261646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.262114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.269318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:59.271009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:45:59.286204 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:45:59.287150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:45:59.288035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:45:59.290484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/929] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:45:59.297317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:59.363427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:59.404350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4dd02-5162-4275-8083-f6fe99fdad9d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:59.438791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:59.439502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.439786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.440059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.440870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:45:59.441179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:59.442604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a99e0-1c14-432c-aeb7-9565d68b16f8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:59.456502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 472/930] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:45:59.462581 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:59.486347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:59.530102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd6a6-6a12-4074-b5d3-589a1a1afe90 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.530747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd6a6-6a12-4074-b5d3-589a1a1afe90 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.531207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffd6a6-6a12-4074-b5d3-589a1a1afe90 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.533096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 473/931] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:45:59.538546 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.538830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.539107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.556566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:45:59.558653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:45:59.577722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f1d9b-c401-4136-ad6c-f69426d7f7f3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:59.623057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:59.624089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.624504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.624893 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/40b5c686224c477d907c4060565b8eb1/roles/d5f1a17dc0f0417880f6b85cb2849267` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.627233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=40b5c686224c477d907c4060565b8eb1, role_id=d5f1a17dc0f0417880f6b85cb2849267)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:59.628899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:59.641227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 474/932] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:45:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:45:59.664736 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:45:59.704156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/933] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:45:59 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/40b5c686224c477d907c4060565b8eb1/roles/d5f1a17dc0f0417880f6b85cb2849267 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:45:59.730883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:45:59.789831 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958081d-847b-493f-8d87-b26f2f991d62 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:45:59.830611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:45:59.831539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:45:59.831970 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:45:59.832388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:45:59.833394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:45:59.835009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:45:59.836557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING keystone.server.flask.common [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 10 12:45:59.917101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 10 12:45:59.917101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 10 12:45:59.917101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [parameters: {'id': 'e29f342bec7945f78e0f9a931d256de2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 10 12:45:59.917101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e29f342bec7945f78e0f9a931d256de2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e29f342bec7945f78e0f9a931d256de2. Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:45:59.936358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 10 12:45:59.937406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() Jun 10 12:45:59.938612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 12:45:59.939743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 10 12:45:59.940867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:45:59.941838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'id': 'e29f342bec7945f78e0f9a931d256de2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:59.943003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:45:59.944077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e29f342bec7945f78e0f9a931d256de2. Jun 10 12:45:59.945258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:45:59.947876 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 475/934] 10.222.0.10 () {60 vars in 1140 bytes} [Fri Jun 10 12:45:59 2022] POST /identity/v3/projects => generated 262 bytes in 283 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:45:59.953394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.037056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.060155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e1be5-51f4-4b49-a279-83cd1faff334 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.096787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.097716 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.097996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.098268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.106868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.108801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-851dd544-93fe-4685-9df0-7979ed1af5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:46:00.123637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:00.125885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:00.128542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/935] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:00.131090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.165446 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b221a-b3cd-46b2-9a76-c972e7bcb359 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.165748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b221a-b3cd-46b2-9a76-c972e7bcb359 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.166168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b221a-b3cd-46b2-9a76-c972e7bcb359 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.168897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/936] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:00.174157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.174448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.174731 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.192525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:00.193752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:00.248357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9a5d-190e-4daf-b59f-30a0603b83a5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.258492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.275013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/937] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:00.284547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.285330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.285747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.286135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.287001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:00.287379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.289186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e98c59-895a-4e69-a677-764cb05fdedd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.294303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.314694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 476/938] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:00.375341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.376841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8682-6a41-4587-bb3e-5788b357d4f8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.377195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8682-6a41-4587-bb3e-5788b357d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.377473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f8682-6a41-4587-bb3e-5788b357d4f8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.383224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 477/939] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:00.389277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.389277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.389277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.405304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:00.406979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:00.413540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbda7ba-58ce-4a29-8379-6213d638d8be None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.453710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.454602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.454982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.455375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.456155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.457729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:00.470994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:00.472548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:00.473434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/940] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:00.479558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.496899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 478/941] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:00.512464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.594909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81321d09-d6e5-4e63-9b81-79f3278631c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.622958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.627127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfd725-6a1c-4de9-ab35-ae1555a0d47f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.638657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.643921 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.644697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.644962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.645941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:00.646325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.647610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.653856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/942] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:00.659456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.668783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.670324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.670610 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.670958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.671988 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.673729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:00.690575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:00.691544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:00.692698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 479/943] 10.222.0.10 () {56 vars in 1132 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:00.698522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.781019 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e1860-b75a-4b19-a306-60bea6cf1acd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.820192 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.820961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c7b91-89b7-4f7d-bf9b-10ebb8887959 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.821074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.821451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.821811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.823154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:00.823509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.825220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.832421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/944] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:00.837663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.863104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.864248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.864782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.865275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.866193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:00.866744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.868398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.875034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 480/945] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:00.886203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:00.901941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.933082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:00.948777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9481f-4975-46e7-85e5-eaf0722d05d9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:00.986946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:00.988037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:00.988466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:00.988991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:00.989938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] RBAC: Adding query filter params (interface=public, service_id=6083bb7b8e0e48e8b85b90b896eb7cf6, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:00.990457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:00.992084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:00.998316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/946] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/endpoints?service_id=6083bb7b8e0e48e8b85b90b896eb7cf6&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:01.003646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:01.016743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e093b64-42c6-4739-993d-d97010c7bef7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:01.054745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:01.055625 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:01.056059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:01.056507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:01.058132 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:01.058590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:01.060194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:01.070797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 481/947] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:01.072406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:01.130199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8ea27-4bd5-4dbb-aaa5-58abd4618b6e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:01.159477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:01.171711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:01.173912 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:01.174853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:01.175144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:01.175426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:01.176117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:01.178031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e23bcb-996d-476b-a402-338c09b6e5ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:01.183791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890621a5-909c-4085-94b3-64b642b729cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:01.188773 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/948] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:46:01 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 12:46:01.231730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:01.232905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:01.233427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:01.233911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:01.234893 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:01.236547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a8d24-ae23-4e83-8f8e-6f95eaf86fa7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:01.323818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 482/949] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:46:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:46:01.866379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae96c-2369-43f4-9ab6-099e3aa77fa6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:01.866890 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae96c-2369-43f4-9ab6-099e3aa77fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:01.866890 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae96c-2369-43f4-9ab6-099e3aa77fa6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:01.868416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/950] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:01.873897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:01.874315 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:01.874490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:01.891852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:01.893376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:01.970003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 483/951] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:01.992887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fae96c-2369-43f4-9ab6-099e3aa77fa6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.098792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fae96c-2369-43f4-9ab6-099e3aa77fa6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.135541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.136264 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.136542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.136847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.147362 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:02.156046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:02.157094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:02.158450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/952] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:46:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:02.163108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.233106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:02.262711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70524357-8511-4222-be72-2088eb5a84e3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.296788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.297456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.297736 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.298010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.298749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:02.299055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:02.300412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:02.309864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 484/953] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:46:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:02.315380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.367838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:02.421644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a9a0d-6cbe-481c-a908-26e8355e76b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.456562 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.457385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.457675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.457944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.469570 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:02.471019 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:02.488857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:02.489786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:02.490661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:02.490661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:02.490661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:02.490661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:02.492947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/954] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:02.500651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.607062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930558d-e3e6-4990-9f50-0580d1699b59 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.645332 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.645994 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.646277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.646554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.647277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:02.647585 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:02.648983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d49e8-0b26-46d3-b548-6f5d9695374e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:02.650383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:02.662256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 485/955] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:02.670029 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.681749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ebc0-d8ca-4330-94d8-b783f0c98683 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.682422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ebc0-d8ca-4330-94d8-b783f0c98683 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.682892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72ebc0-d8ca-4330-94d8-b783f0c98683 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.684383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 486/956] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:02.689069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.689358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.689636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.706129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:02.707290 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:02.776809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 487/957] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:02.790897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f68ff-2139-4525-b83b-260ef1b6a198 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.801379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:02.809199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.840871 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.842214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.842782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.843277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.853025 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:02.855856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:46:02.874822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:02.876199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 10 12:46:02.877157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:02.878283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/958] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:46:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:02.884518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:02.923508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03070400-9cf6-455b-9390-0c333c5914a6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:02.955426 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:02.970296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:02.971328 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:02.972019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:02.972901 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:02.974102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:02.976172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:02.992933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f873114-99ba-461e-90dc-173d66045599 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.027219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.027931 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.028216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.028495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.029371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:03.029658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.030771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 10 12:46:03.030771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 10 12:46:03.030771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [parameters: {'user_id': '250157093b8f4450bfa71ccdf15c18d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 10 12:46:03.030771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 10 12:46:03.031072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Jun 10 12:46:03.040646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:46:03.041818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 10 12:46:03.042775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 10 12:46:03.043684 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 10 12:46:03.044857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 10 12:46:03.045696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'user_id': '250157093b8f4450bfa71ccdf15c18d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:03.046521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 10 12:46:03.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.048242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 488/959] 10.222.0.10 () {60 vars in 1131 bytes} [Fri Jun 10 12:46:02 2022] POST /identity/v3/users => generated 160 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:03.055499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.068505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/960] 10.222.0.10 () {56 vars in 1149 bytes} [Fri Jun 10 12:46:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:03.069677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.090686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.171716 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8302f-8821-40a8-a4fd-7d5cfe5a17f5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.176576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68a8d3-6288-44cc-91cc-132fa9ec454e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.209416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.210253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.210659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.211033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.213774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.214646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.215107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.215555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.220383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.222130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:46:03.237587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:03.238591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 10 12:46:03.239646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:03.243731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 489/961] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:03.244864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.290577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.292902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.299550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.312227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.362671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d977fa-d873-4663-9dfe-1f403de0693c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.406984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/962] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:03.408329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.409979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.412482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.412791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.413643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:03.413952 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.415389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759fcc8-0e74-4cf4-9c7c-2fc3b1ea22a1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.457894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 490/963] 10.222.0.10 () {56 vars in 1101 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:03.459267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620dc1b-d610-43fd-9602-8edb314b72e2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.459612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620dc1b-d610-43fd-9602-8edb314b72e2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.459834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620dc1b-d610-43fd-9602-8edb314b72e2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.461468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 491/964] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:03.470910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e1e9-e631-44c2-bc4a-07a1a0e5f82c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.471263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e1e9-e631-44c2-bc4a-07a1a0e5f82c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.471494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e1e9-e631-44c2-bc4a-07a1a0e5f82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.492242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7d35e1e9-e631-44c2-bc4a-07a1a0e5f82c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:03.494809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7d35e1e9-e631-44c2-bc4a-07a1a0e5f82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:03.550153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec7fc3-ff4f-48c7-8e5e-0603a9b41efc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.575821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.589214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 492/965] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:03.598857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4da5-7b9a-420e-90d8-fe228f28f270 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.599170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4da5-7b9a-420e-90d8-fe228f28f270 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.599432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe4da5-7b9a-420e-90d8-fe228f28f270 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.602888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.604507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.605018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.605508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.606161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 493/966] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:03.607567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.607861 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.608143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.622782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.624257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.629223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:03.630448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:03.642301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:03.644345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/967] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:03.645321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.666788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.714695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 494/968] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:03.715550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.774515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602be37-7196-4434-ae78-bea41c6c46d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.809675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.810477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.810765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.811045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.811698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.813110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.817983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a497d60-ab23-478e-aafe-decc2052a98c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:03.824958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:03.826026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.826906 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/969] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:03.827842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.857945 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.858603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.858894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.859171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.859894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:03.860201 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.861603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.862505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.873339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 495/970] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:03.874137 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:03.900229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:03.928049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637c38d-7956-49ba-9624-9979f404cc0c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.963579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34069852-4188-4596-b637-55c9fd924532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:03.964364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069852-4188-4596-b637-55c9fd924532 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:03.964675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069852-4188-4596-b637-55c9fd924532 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:03.965008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34069852-4188-4596-b637-55c9fd924532 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:03.965610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34069852-4188-4596-b637-55c9fd924532 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:03.966977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34069852-4188-4596-b637-55c9fd924532 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:03.973404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f60e46-755d-42b1-8b8e-2d4d969a6ef7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-34069852-4188-4596-b637-55c9fd924532 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:03.978556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:03.980134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:03.981007 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/971] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:03.982584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34069852-4188-4596-b637-55c9fd924532 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.008742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.009396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.010208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.010489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.011260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.011565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.012936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.017546 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 496/972] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:04.018308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.079373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:04.082850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34069852-4188-4596-b637-55c9fd924532 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.105972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:04.115779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.116573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.116885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.117157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.117695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff2950-805c-4059-af33-63b62db1e37e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.123940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.125487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:46:04.140270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:04.141329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/973] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:04.142232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.157952 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.158611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.158895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.159179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.159881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.160187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.161573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.166979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 497/974] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:04.167745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.239559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e79bb6-64ad-46db-a432-42e1c25204af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.267620 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69e9ba-97cb-4a6e-bb64-15881f0479a2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.273584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.274308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.274595 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.274874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.276223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.276533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.278023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.282946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/975] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:04.283808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.302309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.302963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.303245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.303519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.304291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.304600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.306036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.307681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:04.317790 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 498/976] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:46:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:04.318529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.335244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:04.382181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc434b90-dba2-42f6-8b9f-6e387e10b3d3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.416103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.416791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.417075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.417314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f11f5-7a1f-4a02-ba7a-64fb148ef7a3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.417421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.418044 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.418349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.420015 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.424372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/977] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:04.425188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:04.458448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.459133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.459583 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.459869 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.461309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.462742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4e8a-f9c0-404d-adb4-39e43c567a2f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.518939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:04.533354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 499/978] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:46:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:04.535318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35203000-0dc0-498f-89f4-0e0a5344848e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:04.590389 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:04.591075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:04.592165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:04.592165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:04.592455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] RBAC: Adding query filter params (role.id=d5f1a17dc0f0417880f6b85cb2849267, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=40b5c686224c477d907c4060565b8eb1) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:04.592806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:04.594291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e266da-ce3b-4c9e-99dc-9cd4f72379fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:04.601958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/979] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:04 2022] GET /identity/v3/role_assignments?user.id=40b5c686224c477d907c4060565b8eb1&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=d5f1a17dc0f0417880f6b85cb2849267 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:06.557514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865d6e-4826-4dd0-95cf-ca1f1f48eec8 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.558037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865d6e-4826-4dd0-95cf-ca1f1f48eec8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.558037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57865d6e-4826-4dd0-95cf-ca1f1f48eec8 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.559462 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 500/980] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:06.564442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852274-2e7c-49c7-8742-6947eb4741c6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.564870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852274-2e7c-49c7-8742-6947eb4741c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.565027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c852274-2e7c-49c7-8742-6947eb4741c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.582147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3c852274-2e7c-49c7-8742-6947eb4741c6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:06.583327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3c852274-2e7c-49c7-8742-6947eb4741c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:06.660671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/981] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:06.679604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57865d6e-4826-4dd0-95cf-ca1f1f48eec8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:06.726385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ba8d-beaa-470b-8267-f464e7db932b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.726685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ba8d-beaa-470b-8267-f464e7db932b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.726964 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ba8d-beaa-470b-8267-f464e7db932b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.728433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/982] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:06.734314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef16-4968-440c-bd73-d205b1784c65 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.734603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef16-4968-440c-bd73-d205b1784c65 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.734881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcef16-4968-440c-bd73-d205b1784c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.752335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-21dcef16-4968-440c-bd73-d205b1784c65 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:06.753575 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21dcef16-4968-440c-bd73-d205b1784c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:06.757706 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:06.793543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57865d6e-4826-4dd0-95cf-ca1f1f48eec8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:06.825208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/983] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:06.826511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917bbb-f516-4181-ae94-093908b8e551 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.826802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917bbb-f516-4181-ae94-093908b8e551 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.827076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917bbb-f516-4181-ae94-093908b8e551 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.828313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/984] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:06.832517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:06.833422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.833558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:06.833839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.834118 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.834286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:06.834700 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:06.835572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:06.837296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:06.845735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:06.852300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:06.859185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:06.916698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 501/985] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:46:06 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:06.916698 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:06.927341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/986] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:06.952653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.034909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861091e-1464-4aa5-b1f6-813101cb2435 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.067542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.068397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a6094-719f-40ca-8e01-c5d1ef0c4cd7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.082513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.082513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.082513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.082513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.082897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.082897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:07.096500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:07.097932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:07.098950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 502/987] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:07.107372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.113738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.117534 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.118416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.118698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.119005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.120213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.121625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:07.133347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:07.134640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:07.135584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/988] 10.222.0.10 () {56 vars in 1105 bytes} [Fri Jun 10 12:46:06 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:07.140524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.218803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fae19-1fa0-4907-9b66-57ec8acdb042 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.241086 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b38bcd-6322-43ac-b155-e9f5ee0e157b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.255779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.256476 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.256796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.257130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.257843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:07.258154 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.259519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.265174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 503/989] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:07.270630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.282065 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.283105 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.283444 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.283721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.284426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:07.284764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.286338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.292297 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/990] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:07.297848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.330704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.360854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.379640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44048657-84d9-416c-8e31-0d26fbb7754c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.404285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25578c81-5e31-4549-9302-dbac5f5d98f6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.418474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.419145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.419434 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.419964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.420701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:07.421015 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.422430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.428002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 504/991] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:07.433991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.448397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.449093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.449377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.449665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.450349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:07.450653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.452020 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.456678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/992] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:07.552240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa86a-9099-4f4a-be17-23236c066207 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.576780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.592338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.593047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.593332 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.593609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.594519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] RBAC: Adding query filter params (interface=admin, service_id=6083bb7b8e0e48e8b85b90b896eb7cf6, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:07.594840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.596238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5bae3-8e00-4600-8b16-1820e29e6ff9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.607850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 505/993] 10.222.0.10 () {56 vars in 1249 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/endpoints?service_id=6083bb7b8e0e48e8b85b90b896eb7cf6&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:07.609133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:07.711500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70117-73e4-49e2-bfaa-c7335e5d2068 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:07.735819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:07.746480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:07.747139 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:07.747417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:07.747688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:07.748363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:07.749755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8ff86-ab95-4d9a-b5d2-22698329841d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:07.756359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/994] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:46:07 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 12:46:09.078508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284759f-6cae-475d-b551-2a0e464179aa None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.079031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284759f-6cae-475d-b551-2a0e464179aa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.079110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284759f-6cae-475d-b551-2a0e464179aa None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.080585 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 506/995] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:09.085446 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.085846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.086005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.103073 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:09.105008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:09.171880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/996] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:09.193939 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284759f-6cae-475d-b551-2a0e464179aa None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.293809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284759f-6cae-475d-b551-2a0e464179aa None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.326909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.327701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.327985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.328261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.328989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:09.330302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:09.341979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:09.342992 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:09.343835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:09.351095 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 507/997] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:09.351231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.450343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a05ce7-4d47-4373-8a69-b6202a939b91 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.467580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:09.484853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.485515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.485799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.486073 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.486778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:09.487084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:09.488452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d2537-43c0-422b-a6fd-737ac4ace21f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:09.493524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/998] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:09.499826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.551877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:09.619621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8420d6f-0823-4562-9f75-05afe31e9c0d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.627331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8dd7-ec3f-40fa-87ba-28c65a72b9f8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.627619 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8dd7-ec3f-40fa-87ba-28c65a72b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.627899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc8dd7-ec3f-40fa-87ba-28c65a72b9f8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.629306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/999] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:09.634268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.634592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.634866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.652040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:09.653265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:09.661331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79910-bf18-4991-a202-650e1556463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.662178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79910-bf18-4991-a202-650e1556463d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.662946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79910-bf18-4991-a202-650e1556463d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.663382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a79910-bf18-4991-a202-650e1556463d None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.664561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a79910-bf18-4991-a202-650e1556463d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:09.665141 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a79910-bf18-4991-a202-650e1556463d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:09.666606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a79910-bf18-4991-a202-650e1556463d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:09.671935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 508/1000] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:09.677601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79910-bf18-4991-a202-650e1556463d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.732521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/1001] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:09.756694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.787741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a79910-bf18-4991-a202-650e1556463d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.801410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:09.828591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.829594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.830797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.831127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.831971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] RBAC: Adding query filter params (interface=public, service_id=3783878eab314e60a5cf6b0a17d8ef8a, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:09.832366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:09.833882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:09.841851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 509/1002] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:46:09 2022] GET /identity/v3/endpoints?service_id=3783878eab314e60a5cf6b0a17d8ef8a&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:09.847621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:09.871346 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea595d7f-0baf-4845-818a-cba4154f208f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.886012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:09.908348 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.909037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.909321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.909595 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.910307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:09.911668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf60250-ed5c-4925-ba5a-afeb9fc934be None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:09.950219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df88848d-0010-493c-a321-a226bf8407b3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:09.977740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/1003] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:46:09 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:46:09.979580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e793-a964-482e-918a-d12e30c656ef None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.979867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e793-a964-482e-918a-d12e30c656ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.980142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43e793-a964-482e-918a-d12e30c656ef None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.981417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/1004] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:09.988775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.989112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.989337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:09.998337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:09.999023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:09.999309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:09.999586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:10.000283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:10.001751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:10.009142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 510/1005] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:46:09 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 12:46:10.009743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:10.011176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:10.094509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/1006] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:09 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:10.118417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:10.162069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:10.231618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb033b7c-b378-487d-ad09-619123eeac06 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:10.266534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:10.267341 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:10.267624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:10.267960 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:10.268638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:10.270118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:10.282802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:10.283797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:10.284657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 511/1007] 10.222.0.10 () {56 vars in 1126 bytes} [Fri Jun 10 12:46:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:10.292015 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:10.392845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69157a-5ad8-4dac-a3a8-022829c4e4f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:10.394396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:10.428327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:10.429161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:10.429449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:10.429894 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:10.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:10.431280 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:10.432804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:10.437922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/1008] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:10.443504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:10.545478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:10.548494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fee924-ae0b-4622-af31-e66f8038609a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:10.582124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:10.582782 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:10.583060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:10.583336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:10.584030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:10.584334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:10.585710 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929f290-3c09-4f63-b6ca-4f5d84eb7c95 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:10.591403 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 512/1009] 10.222.0.10 () {56 vars in 1122 bytes} [Fri Jun 10 12:46:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:10.596786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:10.697663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab65fe5-c72b-4755-8cef-f88c3e810076 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:10.731896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:10.732558 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:10.732866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:10.733138 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:10.733886 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:10.735261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb996c-3c61-49e0-961c-69e5ccdc2867 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:10.807975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/1010] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:46:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:46:12.162358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588535-091d-4a72-895a-d41042823d23 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.162916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588535-091d-4a72-895a-d41042823d23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.162916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02588535-091d-4a72-895a-d41042823d23 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.164566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 513/1011] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:12.167077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a8745-fa08-44c2-9d30-383744b84d9f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.167486 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a8745-fa08-44c2-9d30-383744b84d9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.167656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a8745-fa08-44c2-9d30-383744b84d9f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.169154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/1012] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:12.170130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.170392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.170671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.173967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.174207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.174485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.187372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:12.188549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:12.191484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:12.192669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:12.213434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.262208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 514/1013] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:12.267662 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/1014] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:12 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:12.284673 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.289644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.378990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.389384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede3af-f4dc-4867-91fe-5cd5091123e6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.394729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db8999-4ddb-4888-a56e-e97d19e83ed8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.428247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.429034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.429387 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.429556 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.430208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.431637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.432659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.433451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.433732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.434004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.434650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.435998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:12.443421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:12.444377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:12.451083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 515/1015] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:12.452349 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:12.453289 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:12.455089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/1016] 10.222.0.10 () {56 vars in 1105 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:12.458128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.458980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.473313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.558663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b074307-0d2a-403d-92d7-ce5587101487 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.562915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08febfa0-75cc-4e5d-9f87-20648e06c988 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.596443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.597142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.597428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.597705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.598312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.598443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:12.598709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.599135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.599480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.599816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.600065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.600664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:12.601074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.602381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.608084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 516/1017] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:12.612252 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.613103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/1018] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:12.618359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.637544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.700157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.720442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ffb2f-86cc-41f4-8580-91f99aafb310 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.725273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0c23e-c683-404e-8e19-9eeb4c61bf79 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.757600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.758249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.758531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.758805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.759541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:12.759708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.759859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.760338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.760648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.760910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.761225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.761613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:12.761918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.763256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.766452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/1019] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:12.768653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 517/1020] 10.222.0.10 () {56 vars in 1112 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:12.772424 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.773636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.857193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.875995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40455-040e-4502-8c41-9692890c0e56 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.883535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb361e-c377-4068-879f-579a244a7f71 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:12.916485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.916724 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:12.917194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.917398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.917479 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.917555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.917747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.917847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.918519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] RBAC: Adding query filter params (interface=public, service_id=e40bdc3d89b04adab2ff48a79e55ac3d, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:12.918632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.918815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:12.920161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c5b6e-a728-4c3a-bf74-7ba6a053937a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.920406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:12.926003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/1021] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/endpoints?service_id=e40bdc3d89b04adab2ff48a79e55ac3d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:12.931130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:12.942503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:12.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 518/1022] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:46:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:46:12.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a7dc-4c02-49f3-87b3-d8de718381dd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a7dc-4c02-49f3-87b3-d8de718381dd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219a7dc-4c02-49f3-87b3-d8de718381dd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:12.985472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 519/1023] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:12.987190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:12.987704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:12.987937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:13.006400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:13.007623 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:13.039578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f374e6-88f4-4bca-9ca1-6fbf8f286c21 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:13.090266 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:13.091230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:13.091614 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:13.091898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:13.092571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:13.093422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 520/1024] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:13.093991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:13.104812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/1025] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:46:12 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 12:46:13.118162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:13.190938 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:13.234110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4af94-5f26-4b51-885c-00a2df8345b3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:13.273030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:13.273833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:13.274117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:13.274397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:13.276247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:13.278466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f6b13-9486-4312-98d2-c3068c32b22f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:13.280329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 521/1026] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:13.286261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:13.359590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:13.393847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946bbc1-409d-4749-a560-53968f7f85c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:13.429563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:13.430224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:13.430503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:13.430773 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:13.431777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:13.433243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ceb0cc-44dd-49f0-9e55-087431935743 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:13.510946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/1027] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:46:13 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:15.273127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5c6e-6882-4c11-8428-1d92415bb6c0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.273719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5c6e-6882-4c11-8428-1d92415bb6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.273719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a5c6e-6882-4c11-8428-1d92415bb6c0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.275053 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 522/1028] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:15.280679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff1b9-3512-47c1-8c3d-2da8ce55f3d5 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.281132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff1b9-3512-47c1-8c3d-2da8ce55f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.281225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ff1b9-3512-47c1-8c3d-2da8ce55f3d5 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.281544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.281840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.282124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.282737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/1029] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:15.287926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.288208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.288484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.305808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:15.307926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:15.309010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:15.310331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:15.386602 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 523/1030] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:15.391001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/1031] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:15.412472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.420920 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.481539 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:15.488839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:15.536189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915445e4-9da4-4e52-8156-f04d3598ed5e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.545895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a543d-84c7-4f89-9294-cb95917f8e9c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.575910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.576758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.577048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.577330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.584337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.585168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.585450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.585883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.586385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:15.588352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:15.589677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:15.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:15.599146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:15.599999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:15.601403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:15.602380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 10 12:46:15.603281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:15.604927 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 524/1032] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:15.609248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.609587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/1033] 10.222.0.10 () {56 vars in 1105 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:15.610081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.725895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504651c2-6c76-47e6-ae31-f934cd6ab3ec None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.727225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae27a3-56d4-4b2c-9a72-9614949dd242 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.748156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:15.749495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:15.761216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.761882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.762180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.762620 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.763365 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:15.763676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:15.765078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6edc-158c-4a73-bf29-760d30b10aa3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:15.770520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.771576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.772085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.772479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.773740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] RBAC: Adding query filter params (name=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:15.774251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:15.780265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 525/1034] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:15.786267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:15.786393 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fbbb-cbc8-4a9e-ae07-6c4bd9154f10 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.786393 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fbbb-cbc8-4a9e-ae07-6c4bd9154f10 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.786541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/1035] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:15.786541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.786897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fbbb-cbc8-4a9e-ae07-6c4bd9154f10 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.786897 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 526/1036] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:15.788798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4fbbb-cbc8-4a9e-ae07-6c4bd9154f10 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:15.893920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4fbbb-cbc8-4a9e-ae07-6c4bd9154f10 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.895515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168e2da-c617-4f52-9527-444b2148fd32 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:15.929309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.929971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.930254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.930528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.931284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] RBAC: Adding query filter params (type=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:15.931796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:15.931913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:15.932658 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.932923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.933198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.933410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e3d8-3e81-49f2-8c76-65eda0e02b18 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:15.938919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 527/1037] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:15.940136 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:15.940424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:15.940733 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:15.949252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:15.950709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:15.958340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:15.959534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:15.968861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:15.969794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:15.970686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:15.970686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:15.970686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:15.970686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:15.970686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/1038] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:15.970962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.007532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.007737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.038958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 528/1039] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:16.039734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.085791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a0501-f0a3-4318-911b-326d1573e611 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.120183 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.120930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.121209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.121506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.122247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.123949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.149714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e22ced-d470-4133-af17-68f6f796c464 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.183780 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.184428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.185717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.185717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.185717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:16.186001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.187354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.198637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 529/1040] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:16.199397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.220651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/1041] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:46:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:16.220651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.249428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.318165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7886a-55d6-4106-b311-20e09c0fd1ab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.331883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.353617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32323019-32f2-45a5-ae86-682096d8684d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.358597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.359444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.359725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.360000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.361260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.362790 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.364526 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 530/1042] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:16.371031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.398271 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.399070 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.399372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.399615 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.407864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.409351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:46:16.426479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:16.427480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:16.428465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/1043] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:16.435199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.480693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54c81a-79d4-4b9e-bdb2-d9705f8e2180 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.488043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.517399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.518071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.518358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.518635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.519358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.520967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.546807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3abd4f7-cac5-40ae-ab37-f6b24ee5ace8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.581714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.582305 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.582589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.582891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.583740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:16.584054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.585529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.599388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.603033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/1044] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:16.609622 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:16.614745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 531/1045] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:46:16 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:46:16.722278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf15f-b7bb-49f4-b032-a4388100195d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:16.761332 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:16.762006 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:16.762294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:16.762572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:16.831630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:16.834207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:16.835692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:16.938503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1046] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:16.944407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:17.046923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab0d0-119c-42e8-9ea5-4eb9025c070f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:17.081112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:17.081903 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:17.082189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:17.082463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:17.093272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:17.094637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:17.112009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:17.112969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:17.113854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:17.113854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:17.113854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:17.113854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:17.113854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 532/1047] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:17.120579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:17.218185 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:17.221383 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c81f8-f9ff-48f9-8f9f-a899f97e2d11 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:17.255134 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:17.255794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:17.256107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:17.256350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:17.257096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:17.257404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:17.258763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:17.270340 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1048] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:17.276271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:17.293108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:17.380560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da511ca-ef28-481f-83fd-fc297e58bdb3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:17.415270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775496-a347-4974-ada5-21235c537a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:17.416663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775496-a347-4974-ada5-21235c537a83 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:17.416955 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775496-a347-4974-ada5-21235c537a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:17.417229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775496-a347-4974-ada5-21235c537a83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:17.424356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775496-a347-4974-ada5-21235c537a83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:17.425833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775496-a347-4974-ada5-21235c537a83 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-25775496-a347-4974-ada5-21235c537a83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:46:17.439331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:17.440227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:17.441158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:17.444702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 533/1049] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:17.446370 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:17.549044 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd9d3b-29c9-48c8-9a43-d93fa9cda860 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:17.585219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:17.585865 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:17.586145 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:17.586417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:17.587190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:17.587694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:17.589149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc58fa1-02a9-4c60-8df6-47d7ad82d2d9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:17.604649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1050] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:17.607950 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775496-a347-4974-ada5-21235c537a83 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:17.690960 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:17.715393 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775496-a347-4974-ada5-21235c537a83 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:17.749497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:17.750152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:17.750440 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:17.750718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:17.751560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] RBAC: Adding query filter params (role.id=d5f1a17dc0f0417880f6b85cb2849267, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:17.751874 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:17.753374 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad78db-6cd6-4096-9678-bbbaf301e4fb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:17.768668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 534/1051] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:17 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=d5f1a17dc0f0417880f6b85cb2849267 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:18.421217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977f38-3b21-4257-87a6-c6b6d3b1e80e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:18.421510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977f38-3b21-4257-87a6-c6b6d3b1e80e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:18.421794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89977f38-3b21-4257-87a6-c6b6d3b1e80e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:18.423169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1052] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:18.428217 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01311-1562-41a9-8840-e924489025df None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:18.428683 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01311-1562-41a9-8840-e924489025df None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:18.428788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba01311-1562-41a9-8840-e924489025df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:18.445929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dba01311-1562-41a9-8840-e924489025df None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:18.447701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dba01311-1562-41a9-8840-e924489025df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:18.518652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 535/1053] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:18.541668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89977f38-3b21-4257-87a6-c6b6d3b1e80e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:18.566764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:18.660061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89977f38-3b21-4257-87a6-c6b6d3b1e80e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:18.695060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:18.695634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:18.695935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:18.696255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:18.768510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:18.770034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:18.793313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:18.820714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a628-2186-4d14-85d0-3ee2f1bebdaa None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:18.821060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a628-2186-4d14-85d0-3ee2f1bebdaa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:18.821280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a628-2186-4d14-85d0-3ee2f1bebdaa None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:18.823103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 536/1054] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:18.828825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:18.829169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:18.829413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:18.847262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:18.848473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:18.883110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1055] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:18.890060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:18.914617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:18.921929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 537/1056] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:18.945571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.001092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3ccf3-088f-4599-9bc8-155cdefe53af None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.027681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.043197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.044107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.044760 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.044987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.051875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43bb28-e9b5-402f-882f-3f0f289f8128 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.056066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.057582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:19.076709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:19.077729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:19.078653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:19.078653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:19.078653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:19.078653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:19.078653 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1057] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:19.083689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.089796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.090625 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.090924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.091199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.101590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:19.109799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:19.110703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:19.111547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 538/1058] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:19.116811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.175666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.192809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9590f911-429e-47a7-b869-89ed61628c69 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.217639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04063e-9cf3-4829-a339-455c1298aeba None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.227634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.229034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.229326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.229600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.230324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:19.230631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.232001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.253177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1059] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:19.254730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.255418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.255800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.256036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.256880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:19.257510 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.258809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.274547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 539/1060] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:19.276465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.312952 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.388323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6213e-6459-4e21-b8a8-2e1a4ef2e382 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.426351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.427222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.427497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.427764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] PATH_INFO: `/v3/users/0e1f599e81f1406fa407e798f2e0a0c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.442529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] RBAC: Authorizing `identity:get_user(user_id=0e1f599e81f1406fa407e798f2e0a0c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.443972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.445876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1061] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/users/0e1f599e81f1406fa407e798f2e0a0c4 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:19.452007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.558061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb4c1e-b9ca-41f0-9772-4d1310e2210f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.577963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.592001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.592679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.592969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.593247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.660153 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.661613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0694b32-a1c3-4032-81af-71fedada889f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.756082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 540/1062] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 10 12:46:19.762599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.854179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.863354 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cca2d-074a-4575-8c4c-53117f46f15c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:19.880906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e5ab-7e50-4061-a845-0300927d0263 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.881192 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e5ab-7e50-4061-a845-0300927d0263 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.881469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e5ab-7e50-4061-a845-0300927d0263 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.882844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 541/1063] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:19.888477 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.888801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.889077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.897750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:19.898606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:19.898891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:19.899168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:19.901240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:19.902747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:19.904451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1064] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:19.906484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:19.907666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:19.912447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:19.922553 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:19.974557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 542/1065] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:19.997726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.013647 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009292c-f698-48e6-9029-86faa81169b6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.047979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.048632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.048933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.049205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.050022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=5dba744efcda4f52a8971bdb4b2c8110, user.id=0e1f599e81f1406fa407e798f2e0a0c4) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:20.050330 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.051749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.057303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1066] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/role_assignments?user.id=0e1f599e81f1406fa407e798f2e0a0c4&scope.project.id=5dba744efcda4f52a8971bdb4b2c8110&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:20.096432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa30e39-054c-4213-8202-2355fd29e95d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.132693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.133417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.133702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.133977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.145240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:20.154234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:20.155629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:20.156665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 543/1067] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:46:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:20.161794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.187695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:20.263569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266f5ee-cb3d-4c09-b396-dfbde9bdd314 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.296590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.297283 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.297576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.297845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.298578 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:20.298880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.300234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.308836 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1068] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:20.314424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.327531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:20.413052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58804a8a-45ef-417a-a296-dcd5eb61a2cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.445762 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.446541 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.446861 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.447337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.457481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.458910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:20.475850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:20.476844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:20.477732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:20.477732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:20.477732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:20.477732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:20.477732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 544/1069] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:20.483026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.566135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:20.581672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6584b1e-8aef-47b4-9e5a-caa210c0501e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.615978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.616934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.617214 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.617485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.618198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:20.618498 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.619852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.630941 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1070] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:20.637149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.697385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:20.734621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5533fa3-0397-4a99-a4ea-a44d98e89ce3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.768180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.768990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.769273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.769548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.776917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.778340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:46:20.792258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:20.793327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:20.794271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 545/1071] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:20.799323 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:20.896508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56045db6-64b1-4467-80b9-296bed70ac0f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:20.929418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:20.930076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:20.930360 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:20.930636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:20.931490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:20.931816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:20.933265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:20.949728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1072] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:20.955184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:21.051749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcfdcf-4746-40c8-8fe0-c86dc66a1602 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:21.073944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:21.085024 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:21.085805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:21.086087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:21.086362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:21.097259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:21.098778 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:21.115819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:21.116944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:21.117865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:21.117865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:21.117865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:21.117865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:21.117865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 546/1073] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:21.123075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:21.126033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:21.224327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6a1b8-d134-46d2-aed4-9805c3fecedb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:21.258706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:21.259898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:21.260184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:21.260450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:21.261187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:21.261489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:21.262892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:21.274236 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1074] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:21.280578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:21.377054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65251c-15f5-40c9-b609-639c11120ff0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:21.409467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:21.410242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:21.410527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:21.410800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:21.418052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:21.419811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:46:21.433785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:21.434662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:21.435745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 547/1075] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:21.440603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:21.500932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:21.539973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbfd73-3331-4253-8083-a4e80932d3f9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:21.573010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:21.573664 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:21.573950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:21.574230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:21.575009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:21.575318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:21.576775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35405f-20f5-4956-b6d4-c3df3b73340c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:21.588592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1076] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:21.594467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:21.630098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:21.696847 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1908c-94bd-415d-9605-1024e77e0334 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:21.731776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:21.732687 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:21.732978 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:21.733258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/d5f1a17dc0f0417880f6b85cb2849267` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:21.735427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=b91f8654801b49689bb5774097b59bb5, role_id=d5f1a17dc0f0417880f6b85cb2849267)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:21.736881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e05da-2efb-4e16-b3f9-d0a5b7341f64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:21.848004 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 548/1077] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:46:21 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/b91f8654801b49689bb5774097b59bb5/roles/d5f1a17dc0f0417880f6b85cb2849267 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 12:46:22.170679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0834e6e-d7d9-455d-b070-dfcb7545fa76 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.171172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0834e6e-d7d9-455d-b070-dfcb7545fa76 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.171277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0834e6e-d7d9-455d-b070-dfcb7545fa76 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.172611 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1078] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:22.177935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.178226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.178504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.195410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:22.196595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:22.261853 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 549/1079] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:22.284352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0834e6e-d7d9-455d-b070-dfcb7545fa76 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:22.385009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0834e6e-d7d9-455d-b070-dfcb7545fa76 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:22.407850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:22.419130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:22.420176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.420457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.420815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.430465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:22.438997 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:22.440126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:22.441351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:22.444771 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1080] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:22.446342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:22.470971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:22.543693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4757e35-acf4-453c-8fe3-e60ed2d43fc9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:22.577168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:22.577824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.578107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.578379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.579114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:22.579417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:22.580808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:22.588793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 550/1081] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:22.594444 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:22.698936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4f353-1980-4793-b4ef-b05dc515c50a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:22.730966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:22.731827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.732108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.732379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] PATH_INFO: `/v3/users/0e1f599e81f1406fa407e798f2e0a0c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.733577 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] RBAC: Authorizing `identity:get_user(user_id=0e1f599e81f1406fa407e798f2e0a0c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:22.735000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:22.736792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1082] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:22 2022] GET /identity/v3/users/0e1f599e81f1406fa407e798f2e0a0c4 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:22.742241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:22.833677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:22.848511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3fabe-bed1-49b9-abd4-6dfa195eb153 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:22.883107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:22.883958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:22.884264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:22.884749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:22.886009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:22.887502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894aaef-ae9f-48a9-a69f-22e5e85c813a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:22.889379 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 551/1083] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:22 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:22.895014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:22.947141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:22.997087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166a877-a979-460d-b0d2-7ef3fecb806a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:23.030195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:23.031075 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:23.031353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:23.031620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110/users/0e1f599e81f1406fa407e798f2e0a0c4/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:23.033584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] RBAC: Authorizing `identity:create_grant(project_id=5dba744efcda4f52a8971bdb4b2c8110, user_id=0e1f599e81f1406fa407e798f2e0a0c4, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:23.035005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee24033-3560-436f-8480-e1984cdde99a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:23.086983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1084] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:46:22 2022] PUT /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110/users/0e1f599e81f1406fa407e798f2e0a0c4/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:46:23.960600 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04abb-25cf-4c66-8f03-0658747a1d38 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:23.961151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04abb-25cf-4c66-8f03-0658747a1d38 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:23.961151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d04abb-25cf-4c66-8f03-0658747a1d38 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:23.962987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 552/1085] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:23.968249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:23.968693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:23.968987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:23.985878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:23.987056 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:24.052270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1086] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:24.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04abb-25cf-4c66-8f03-0658747a1d38 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.175382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d04abb-25cf-4c66-8f03-0658747a1d38 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:24.208384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:24.209207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:24.209490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:24.209763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:24.220249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:24.228889 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:24.229884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:24.230929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 553/1087] 10.222.0.10 () {56 vars in 1120 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:24.236028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.276908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:24.332852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8b0b0-0799-4e93-a74b-a2d60d9c9310 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:24.366357 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:24.367010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:24.367288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:24.367556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:24.368281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:24.368602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:24.370002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:24.377634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1088] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:24.383259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.399449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:24.481450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6e85-2158-4ad5-aebf-fa67792c4823 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:24.513953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:24.514720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:24.515003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:24.515278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:24.525494 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:24.526923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:24.543910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:24.545308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:24.550804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:24.550804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:24.550804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:24.550804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:24.550804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 554/1089] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:24.551140 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.652633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a25b4-94aa-4f24-ac3b-76fd6355fa62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:24.654178 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:24.686449 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:24.687104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:24.687385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:24.687657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:24.688371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:24.688705 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:24.690089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:24.702888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1090] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:24.708556 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.772535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:24.805784 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d346e-e5de-4d8a-ba43-83a9392e4fb3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:24.839704 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:24.840484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:24.840803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:24.841083 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:24.848051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:24.849508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:46:24.863310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:24.864255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:24.865253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 555/1091] 10.222.0.10 () {56 vars in 1093 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:24.870795 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:24.967749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcc86-ffce-4dbc-bcd1-287b6bf6b775 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.000055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.000745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.001031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.001314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.002146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:25.002454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.003873 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3a1e0-45fe-49b8-a5fa-e72d62f0bda8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.021439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1092] 10.222.0.10 () {56 vars in 1133 bytes} [Fri Jun 10 12:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:25.027551 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.125791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b1fa4-1fe2-40a7-9e51-580cdf578e7f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.154484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.162802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.163456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.169262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.169262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.184428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aada-0e82-4587-be01-e3701b2b5929 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.184768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aada-0e82-4587-be01-e3701b2b5929 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.185047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aada-0e82-4587-be01-e3701b2b5929 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.186412 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1093] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:46:25.191251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.191535 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.191809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.208293 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:25.209505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:25.223095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.233078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.234594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.274480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1094] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 10 12:46:25.298744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.330301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 556/1095] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:25.336203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.361386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.394640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86dcab7-48d2-46e9-a013-f7b369288273 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.430166 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.430945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.431260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.431594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.432481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13ae2-e539-433a-9fd5-311ab61a6cca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.441475 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:25.449074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:25.450213 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:25.451197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1096] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:25.456125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.468506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.469323 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.470109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.470392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.470665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.480595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.482061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:25.499425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:25.500491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:25.501670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:46:25.501670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:25.501670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:46:25.501670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:25.501670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 557/1097] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:25.506263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.557735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305266-4411-4de3-84e7-08cb282eefbb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.583786 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.590670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.595620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.603685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1098] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:25.605290 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ad9cd-3b8d-4169-893b-5fea0378c12e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.609684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.641010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.641677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.641960 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.642244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.643026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:25.643336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.644751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.655872 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 558/1099] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:25.661401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.684599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.714190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0418f3-0615-4119-98d1-df2c7fe20c8d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.748809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.749667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.749949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.750218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] PATH_INFO: `/v3/users/0e1f599e81f1406fa407e798f2e0a0c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.751403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] RBAC: Authorizing `identity:get_user(user_id=0e1f599e81f1406fa407e798f2e0a0c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.752853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.754454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1100] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/users/0e1f599e81f1406fa407e798f2e0a0c4 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:25.758187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16d2dc-b854-47b1-9927-c7bca2bd57cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.761625 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.792210 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.793032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.793310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.793580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.800387 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.801851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.803506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:46:25.817018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:25.817956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 559/1101] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:46:25.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:25.861856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f6c-e709-4359-b7bd-8e027f9ddfc4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.894980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.895620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.895903 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.896176 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.906957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:25.922081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba69da-259f-427f-bed4-a90befe5417c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:25.961499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:25.962151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:25.962829 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:25.963146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:25.963941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:25.964250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.965726 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.966058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:25.967533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:25.982423 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 560/1102] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:25.983429 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:26.039092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:26.064741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1103] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 10 12:46:26.070600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:26.080865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b4ff8-bad5-4928-a815-9c19d19e4f59 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:26.110040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:26.114108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:26.114805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:26.115090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:26.115363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:26.116193 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] RBAC: Adding query filter params (role.id=d5f1a17dc0f0417880f6b85cb2849267, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=b91f8654801b49689bb5774097b59bb5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:26.116506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:26.117991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:26.124112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 561/1104] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:25 2022] GET /identity/v3/role_assignments?user.id=b91f8654801b49689bb5774097b59bb5&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=d5f1a17dc0f0417880f6b85cb2849267 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:26.171155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9df7a-6916-4e25-8321-147532f12af7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:26.207497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:26.208369 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:26.208676 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:26.208956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:26.210216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:26.211675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36706c1-9215-499e-8021-3b88d0c3c6d1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:26.214110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1105] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:26 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:46:26.220463 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:26.323856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b0700-c516-416c-af2e-8979eca84857 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:26.346013 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:26.358018 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:26.358677 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:26.358968 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:26.359246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:26.360144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=5dba744efcda4f52a8971bdb4b2c8110, user.id=0e1f599e81f1406fa407e798f2e0a0c4) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:26.360466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:26.361993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc342f7-ef26-4290-a6db-f90f33a0de38 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:26.367923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 562/1106] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:26 2022] GET /identity/v3/role_assignments?user.id=0e1f599e81f1406fa407e798f2e0a0c4&scope.project.id=5dba744efcda4f52a8971bdb4b2c8110&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:28.514291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20e21-6303-4030-b543-30067d0cdf99 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:28.514856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20e21-6303-4030-b543-30067d0cdf99 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:28.514856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20e21-6303-4030-b543-30067d0cdf99 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:28.516206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1107] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:28.521356 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:28.521739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:28.521919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:28.538725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:28.539918 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:28.604281 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 563/1108] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:28.629331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20e21-6303-4030-b543-30067d0cdf99 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:28.729151 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20e21-6303-4030-b543-30067d0cdf99 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:28.737990 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:28.762066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:28.762830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:28.763113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:28.763387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:28.764588 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:28.766088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9903dac8-afb5-48f8-9dfe-1e38ba855247 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:28.767873 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1109] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:28.773448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:28.866758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0de5-082f-49a7-aa48-c600c911bf87 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:28.882226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:28.899333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:28.900549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:28.900855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:28.901128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:28.901819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:28.903233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7e2e6-bc3d-41d3-8313-c918f4841ae7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:28.966788 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 564/1110] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:46:28 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:31.119322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d243d-93dd-4e43-8fd4-db1d6da8453d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.119866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d243d-93dd-4e43-8fd4-db1d6da8453d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.119866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900d243d-93dd-4e43-8fd4-db1d6da8453d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.121285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1111] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:31.126504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.126894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.127067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.144142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:31.145357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:31.209077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 565/1112] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:31.232690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d243d-93dd-4e43-8fd4-db1d6da8453d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:31.331258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900d243d-93dd-4e43-8fd4-db1d6da8453d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:31.363481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:31.364310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.364586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.364883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] PATH_INFO: `/v3/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.366318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] RBAC: Authorizing `identity:get_role(role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:31.367671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:31.369893 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1113] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:31 2022] GET /identity/v3/roles/e253d3f882df44caa26394cdc954b92a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:31.375457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:31.472867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166573a7-0a2f-4624-81ed-d069e077bfcc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:31.474340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:31.506966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:31.507818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.508103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.508382 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] PATH_INFO: `/v3/users/b2f0c9f7c8e64b14827255486cdb18fa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.521404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] RBAC: Authorizing `identity:get_user(user_id=b2f0c9f7c8e64b14827255486cdb18fa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:31.522840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:31.524475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 566/1114] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:31 2022] GET /identity/v3/users/b2f0c9f7c8e64b14827255486cdb18fa => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:31.530649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:31.575776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:31.628632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa3a0a-e127-44ca-9dc0-8ec9f301c043 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:31.661585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:31.662222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.662502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.662775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.727311 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:31.729401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:31.770924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:31.824847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1115] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:31.830695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:31.926364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff97a0-8412-415b-a160-be0d1689e9eb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:31.958916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:31.959753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:31.960038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:31.960311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:31.961499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:31.963543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4137f6-e15f-4098-b6eb-079eafdd369e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:31.965234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 567/1116] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:31 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:31.971271 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:32.069724 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e1fe1-aef6-423d-9b13-92e57c087174 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:32.103418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:32.104047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:32.104325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:32.104597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:32.105445 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=5dba744efcda4f52a8971bdb4b2c8110, user.id=b2f0c9f7c8e64b14827255486cdb18fa) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:32.105753 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:32.107160 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc950260-476a-487b-8092-d9ef0d834c18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:32.112412 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1117] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:31 2022] GET /identity/v3/role_assignments?user.id=b2f0c9f7c8e64b14827255486cdb18fa&scope.project.id=5dba744efcda4f52a8971bdb4b2c8110&role.id=e253d3f882df44caa26394cdc954b92a => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:34.180815 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715052-4223-4c31-b4f9-d40816302a4f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.181405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715052-4223-4c31-b4f9-d40816302a4f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.181514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50715052-4223-4c31-b4f9-d40816302a4f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.182885 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 568/1118] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:34.188186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.188572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.188783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.205912 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:34.207103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:34.209061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:34.272688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1119] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:34.296053 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715052-4223-4c31-b4f9-d40816302a4f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:34.323737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:34.394372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50715052-4223-4c31-b4f9-d40816302a4f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:34.427739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:34.428572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.428878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.429174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] PATH_INFO: `/v3/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.430628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] RBAC: Authorizing `identity:get_role(role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:34.432092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:34.433423 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 569/1120] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:34 2022] GET /identity/v3/roles/e253d3f882df44caa26394cdc954b92a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:34.439117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:34.533437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be21b4b-d6aa-4372-b3d4-9f8ae6bc702d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:34.566581 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:34.567433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.567714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.567987 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] PATH_INFO: `/v3/users/b2f0c9f7c8e64b14827255486cdb18fa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.569182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f0c9f7c8e64b14827255486cdb18fa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:34.570585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:34.572533 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1121] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:34 2022] GET /identity/v3/users/b2f0c9f7c8e64b14827255486cdb18fa => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:34.578254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:34.667624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:34.673326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22135e5-cbb8-420b-9645-8e937921de35 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:34.705197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:34.705974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.706255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.706527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.707678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:34.709127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49661b-ec32-42d1-a3ac-32a33a5860f7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:34.710781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 570/1122] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:34 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:34.717541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:34.726149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:34.813737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde388b2-43dc-4130-bdab-fb5a4f60aa48 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:34.846426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:34.847292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:34.847572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:34.847843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110/users/b2f0c9f7c8e64b14827255486cdb18fa/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:34.850009 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] RBAC: Authorizing `identity:create_grant(project_id=5dba744efcda4f52a8971bdb4b2c8110, user_id=b2f0c9f7c8e64b14827255486cdb18fa, role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:34.851416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec37086-28c8-4a0f-b7f4-e23a809d9628 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:34.926229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1123] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:46:34 2022] PUT /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110/users/b2f0c9f7c8e64b14827255486cdb18fa/roles/e253d3f882df44caa26394cdc954b92a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:46:37.007203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161c27-a166-49ab-a5d4-f73358b2381c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.007732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161c27-a166-49ab-a5d4-f73358b2381c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.007732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f161c27-a166-49ab-a5d4-f73358b2381c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.009567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 571/1124] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:37.014794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.015229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.015365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.032382 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:37.033591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:37.091429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:37.098489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1125] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:37.121300 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161c27-a166-49ab-a5d4-f73358b2381c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:37.221755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f161c27-a166-49ab-a5d4-f73358b2381c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:37.254291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:37.255122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.255411 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.255689 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] PATH_INFO: `/v3/roles/e253d3f882df44caa26394cdc954b92a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.257182 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] RBAC: Authorizing `identity:get_role(role_id=e253d3f882df44caa26394cdc954b92a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:37.258596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:37.260801 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 572/1126] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:37 2022] GET /identity/v3/roles/e253d3f882df44caa26394cdc954b92a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:37.266416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:37.361641 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03688e-1f50-4264-82ed-d524636fbcec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:37.394538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:37.395386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.395667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.395937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] PATH_INFO: `/v3/users/b2f0c9f7c8e64b14827255486cdb18fa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.397123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=b2f0c9f7c8e64b14827255486cdb18fa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:37.398536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:37.400171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1127] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:37 2022] GET /identity/v3/users/b2f0c9f7c8e64b14827255486cdb18fa => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:37.405956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:37.436676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:37.501974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e760c-88e8-455c-966c-1e12f6ee9bc3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:37.534864 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:37.535506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.535792 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.536069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.602489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:37.604273 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:37.633288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:37.699797 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 573/1128] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:37.705751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:37.765580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:37.802112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f6e25-8885-4b41-8902-d4487eede4d5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:37.834249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:37.835089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.835367 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.835638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] PATH_INFO: `/v3/projects/5dba744efcda4f52a8971bdb4b2c8110` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.836812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] RBAC: Authorizing `identity:get_project(project_id=5dba744efcda4f52a8971bdb4b2c8110)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:37.838429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22057880-da94-45cf-a89e-ac1f890bf98f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:37.840065 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1129] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:37 2022] GET /identity/v3/projects/5dba744efcda4f52a8971bdb4b2c8110 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:37.846014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:37.941321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7e93-3eeb-4cc4-8861-ebb51e3526ac None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:37.968583 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:37.973316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:37.973953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:37.974237 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:37.974512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:37.975329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] RBAC: Adding query filter params (role.id=e253d3f882df44caa26394cdc954b92a, scope.project.id=5dba744efcda4f52a8971bdb4b2c8110, user.id=b2f0c9f7c8e64b14827255486cdb18fa) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:37.975639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:37.977095 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0cbeef-1ec8-43d8-8610-cd81ee6f1fc1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:37.983485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 574/1130] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:37 2022] GET /identity/v3/role_assignments?user.id=b2f0c9f7c8e64b14827255486cdb18fa&scope.project.id=5dba744efcda4f52a8971bdb4b2c8110&role.id=e253d3f882df44caa26394cdc954b92a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:40.123222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8789177-4ce4-4436-b282-270b8c456125 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:40.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8789177-4ce4-4436-b282-270b8c456125 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:40.123777 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8789177-4ce4-4436-b282-270b8c456125 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:40.125163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1131] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:40.130371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:40.130748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:40.130935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:40.147572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:40.148803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:40.213738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 575/1132] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:40.237849 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8789177-4ce4-4436-b282-270b8c456125 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:40.335302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8789177-4ce4-4436-b282-270b8c456125 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:40.363344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:40.367953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:40.368862 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:40.369143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:40.369415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:40.370574 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:40.372004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab255-54f3-4311-ac11-ec9826e7b54c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:40.375430 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1133] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:40.379454 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:40.473627 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c07fc-ec82-4767-94bf-3dd60c844046 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:40.498029 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:40.506126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:40.506765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:40.509678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:40.509678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:40.509678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:40.509995 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73f7c-e19c-4227-af1a-b19ec0a14894 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:40.583362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 576/1134] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:46:40 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:42.703766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928f19-3d49-4559-a86d-763c9d9e88bf None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:42.704279 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928f19-3d49-4559-a86d-763c9d9e88bf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:42.704365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928f19-3d49-4559-a86d-763c9d9e88bf None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:42.705689 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1135] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:42.710835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:42.711203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:42.711404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:42.729283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:42.730478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:42.794894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 577/1136] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:42.818725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4928f19-3d49-4559-a86d-763c9d9e88bf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:42.916462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4928f19-3d49-4559-a86d-763c9d9e88bf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:42.949091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:42.949853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:42.950131 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:42.950401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:42.951635 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:42.953074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfff4ac-6ea5-402a-bf8a-256cf4013abb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:42.954634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1137] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:46:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:42.960226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:43.056407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe6366-855a-4bfb-b4ac-39a176f9a4e7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:43.065814 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:43.090529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:43.091183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:43.091465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:43.091739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:43.092437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:43.093909 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5d6e5-bd8d-496e-8aaa-5b06207bc77f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:43.195057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 578/1138] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:46:42 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:46:45.334715 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5894-ddfe-4a3d-8f94-efe1339077af None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:45.335319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5894-ddfe-4a3d-8f94-efe1339077af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:45.335319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c5894-ddfe-4a3d-8f94-efe1339077af None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:45.336604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1139] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:45.342246 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:45.342663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:45.342803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:45.359535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:45.360753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:45.425743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 579/1140] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:45.449521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c5894-ddfe-4a3d-8f94-efe1339077af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:45.560262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:45.592690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c5894-ddfe-4a3d-8f94-efe1339077af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:45.628888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:45.629670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:45.629949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:45.630218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:45.640599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:45.647992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:45.649076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:45.650147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1141] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:45.655163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:45.744487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:45.750802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f5a63-b913-4e35-b3ab-8ff7de580135 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:45.782926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:45.783570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:45.783849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:45.784119 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:45.784880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:45.785185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:45.786530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:45.795289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 580/1142] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:45.801130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:45.902736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75d3b6-c6e4-4491-b720-66ff291a2e55 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:45.927069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:45.935045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:45.935899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:45.936180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:45.938679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] PATH_INFO: `/v3/users/d91a90b15d704454aa806d5d0c32f459` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:45.950049 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] RBAC: Authorizing `identity:get_user(user_id=d91a90b15d704454aa806d5d0c32f459)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:45.951473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:45.953122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1143] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:45 2022] GET /identity/v3/users/d91a90b15d704454aa806d5d0c32f459 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:45.958748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:46.055002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6226fa8-f8af-41be-bee7-86e8bd465262 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:46.088364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:46.089011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:46.089293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:46.089568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:46.112551 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:46.155843 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:46.157257 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:46.252037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 581/1144] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:46.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:46.354378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ab525-bab0-413c-9ef1-57573e2bb296 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:46.388020 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:46.388888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:46.389169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:46.389441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] PATH_INFO: `/v3/projects/9a21fe4118654b2c9f02cc8c0338046e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:46.390606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] RBAC: Authorizing `identity:get_project(project_id=9a21fe4118654b2c9f02cc8c0338046e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:46.392028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4b623-fab3-4cbe-9fbc-b116b39bec9b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:46.393694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1145] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:46 2022] GET /identity/v3/projects/9a21fe4118654b2c9f02cc8c0338046e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:46.400474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:46.454281 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:46.497643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a66cb-8b3b-4e6c-a25a-2fd0aedf9337 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:46.530363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:46.531001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:46.531288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:46.531567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:46.532388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=9a21fe4118654b2c9f02cc8c0338046e, user.id=d91a90b15d704454aa806d5d0c32f459) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:46.532729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:46.534164 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834652e-c77d-4dba-a903-aa7c506014ba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:46.539437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 582/1146] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:46 2022] GET /identity/v3/role_assignments?user.id=d91a90b15d704454aa806d5d0c32f459&scope.project.id=9a21fe4118654b2c9f02cc8c0338046e&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:48.611925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af407e5-df9e-4db4-bd51-5fcfb50dcce2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:48.612478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af407e5-df9e-4db4-bd51-5fcfb50dcce2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:48.612478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af407e5-df9e-4db4-bd51-5fcfb50dcce2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:48.613864 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1147] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:48.619816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:48.620222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:48.620363 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:48.637330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:48.638492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:48.701811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 583/1148] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:48.725887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af407e5-df9e-4db4-bd51-5fcfb50dcce2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:48.780302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:48.823435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af407e5-df9e-4db4-bd51-5fcfb50dcce2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:48.856590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:48.857383 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:48.857659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:48.857924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:48.867566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:48.875063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:48.876171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:48.877306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1149] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:48.882250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:48.931346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:48.979401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db02dc-fc6c-489a-9aef-603e1dc75ecd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:49.013173 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:49.013824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:49.014114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:49.014391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:49.015136 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:49.015445 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:49.016844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:49.025342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 584/1150] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:49.030882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:49.127954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc5f6c-7437-4dc2-9ec0-839cf8aecee0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:49.141453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:49.160896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:49.161746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:49.162029 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:49.162301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] PATH_INFO: `/v3/users/d91a90b15d704454aa806d5d0c32f459` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:49.163466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] RBAC: Authorizing `identity:get_user(user_id=d91a90b15d704454aa806d5d0c32f459)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:49.165034 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:49.166616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1151] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:49 2022] GET /identity/v3/users/d91a90b15d704454aa806d5d0c32f459 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:49.172591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:49.267023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eda4ea-c40d-47c8-93a6-93c864c18a18 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:49.279505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:49.299194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:49.300031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:49.300310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:49.300582 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] PATH_INFO: `/v3/projects/9a21fe4118654b2c9f02cc8c0338046e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:49.301763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] RBAC: Authorizing `identity:get_project(project_id=9a21fe4118654b2c9f02cc8c0338046e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:49.306729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae641d41-39a1-4635-be63-5493c5a38801 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:49.306729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 585/1152] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:49 2022] GET /identity/v3/projects/9a21fe4118654b2c9f02cc8c0338046e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:49.310801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:49.409584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e8f2c-a89e-4e1f-89c4-7b8250fe2214 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:49.442228 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:49.443131 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:49.443411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:49.443682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] PATH_INFO: `/v3/projects/9a21fe4118654b2c9f02cc8c0338046e/users/d91a90b15d704454aa806d5d0c32f459/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:49.445617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a21fe4118654b2c9f02cc8c0338046e, user_id=d91a90b15d704454aa806d5d0c32f459, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:49.447804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c295bc-34f4-41f8-b909-f80181429671 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:49.514144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1153] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:46:49 2022] PUT /identity/v3/projects/9a21fe4118654b2c9f02cc8c0338046e/users/d91a90b15d704454aa806d5d0c32f459/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:46:51.593453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d64bd-e7e1-4106-8a63-96386d4f55df None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:51.593980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d64bd-e7e1-4106-8a63-96386d4f55df None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:51.593980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d64bd-e7e1-4106-8a63-96386d4f55df None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:51.595369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 586/1154] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:51.600821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:51.601221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:51.601371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:51.618495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:51.619700 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:51.653818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:51.684458 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1155] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:51.708417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d64bd-e7e1-4106-8a63-96386d4f55df None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:51.807507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d64bd-e7e1-4106-8a63-96386d4f55df None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:51.840941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:51.841723 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:51.842011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:51.842292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:51.852233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:46:51.859721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:51.860826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:46:51.861743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 587/1156] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:46:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:51.866875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:51.962667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f41fb-8703-48cc-982f-fd85cee823f5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:51.995364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:51.996010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:51.996291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:51.996564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:51.997328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:51.997633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:51.998994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:52.006740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1157] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:52.012513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:52.053920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:52.110269 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f3f8c-0f6d-4eba-bc55-750739cad654 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:52.142865 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:52.143717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:52.144001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:52.144276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] PATH_INFO: `/v3/users/d91a90b15d704454aa806d5d0c32f459` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:52.145466 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] RBAC: Authorizing `identity:get_user(user_id=d91a90b15d704454aa806d5d0c32f459)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:52.146883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:52.148481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 588/1158] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:46:52 2022] GET /identity/v3/users/d91a90b15d704454aa806d5d0c32f459 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:52.155097 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:52.189055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:52.252211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e33477-d293-4223-8af1-0b2e81f4b088 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:52.286095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:52.286725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:52.287003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:52.287274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:52.352889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:52.354328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:52.386104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:52.450520 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1159] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:52.456349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:52.556386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a043b-cf96-4f30-a6f8-6cf492a3b27d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:52.564731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:52.588744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:52.589584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:52.589863 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:52.590134 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] PATH_INFO: `/v3/projects/9a21fe4118654b2c9f02cc8c0338046e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:52.591288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] RBAC: Authorizing `identity:get_project(project_id=9a21fe4118654b2c9f02cc8c0338046e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:52.592729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69ed5-9c59-4b75-98d5-2c0fc6ce1212 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:52.594423 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 589/1160] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:46:52 2022] GET /identity/v3/projects/9a21fe4118654b2c9f02cc8c0338046e => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:52.600334 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:52.696790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1703396-1258-451b-b35d-a136d9fec70e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:52.729959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:52.730613 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:52.730899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:52.731179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:52.732002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=9a21fe4118654b2c9f02cc8c0338046e, user.id=d91a90b15d704454aa806d5d0c32f459) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:52.732315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:52.733797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945dfdf-3438-48ac-a9af-4e3ea0c07736 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:52.735567 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:52.739976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1161] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:46:52 2022] GET /identity/v3/role_assignments?user.id=d91a90b15d704454aa806d5d0c32f459&scope.project.id=9a21fe4118654b2c9f02cc8c0338046e&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:54.884990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07040-7937-4e0f-bfc4-1b851a42714c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:54.885535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07040-7937-4e0f-bfc4-1b851a42714c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:54.885535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b07040-7937-4e0f-bfc4-1b851a42714c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:54.886817 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 590/1162] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:54.891844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:54.892278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:54.892402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:54.909222 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:54.910402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:54.976564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1163] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:54.999406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b07040-7937-4e0f-bfc4-1b851a42714c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:55.098344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b07040-7937-4e0f-bfc4-1b851a42714c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:55.130255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:55.130887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:55.131171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:55.131449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:55.174917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:55.196011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:55.198092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:55.291922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 591/1164] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:46:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:46:55.298165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:55.392754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e531ec-12b7-4fc4-822f-59ed607c2036 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:55.417441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:55.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:55.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:55.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:55.427996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:55.433489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:55.434909 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e252d921-7a5a-4a80-ac9d-6fe73b27b2a6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:46:55.449030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:46:55.450308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:46:55.451403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1165] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:46:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:46:55.456097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:55.529100 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:46:55.551186 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b9010-6e8b-48ba-be7f-63e072627a6d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:55.583076 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:55.583751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:55.584034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:55.584308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:55.585060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:46:55.585366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:55.587415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83be62b-e21c-4775-bf23-1382dc52d3c3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:55.594295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 592/1166] 10.222.0.10 () {56 vars in 1115 bytes} [Fri Jun 10 12:46:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:46:57.681565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a668a-a123-45f0-bfe2-d038e8ecff77 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:57.682099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a668a-a123-45f0-bfe2-d038e8ecff77 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:57.682099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a668a-a123-45f0-bfe2-d038e8ecff77 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:57.683466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1167] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:46:57.688718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8294-144b-401c-b850-1f5817b017bc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:57.689102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8294-144b-401c-b850-1f5817b017bc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:57.689282 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8294-144b-401c-b850-1f5817b017bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:57.705867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8dab8294-144b-401c-b850-1f5817b017bc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:46:57.707057 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8dab8294-144b-401c-b850-1f5817b017bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:46:57.771851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 593/1168] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:46:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:46:57.796892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a668a-a123-45f0-bfe2-d038e8ecff77 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:46:57.893359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a668a-a123-45f0-bfe2-d038e8ecff77 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:46:57.926776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:46:57.927413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:46:57.927697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:46:57.927968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:46:57.928723 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:46:57.930074 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76377408-3b47-4a0e-ac50-2ba6d10296f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:46:58.018787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1169] 10.222.0.10 () {60 vars in 1138 bytes} [Fri Jun 10 12:46:57 2022] POST /identity/v3/domains => generated 267 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:47:00.123586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0616d-4cd8-4f3e-bcd1-e79ba5ee90d4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:00.124117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0616d-4cd8-4f3e-bcd1-e79ba5ee90d4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:00.124231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0616d-4cd8-4f3e-bcd1-e79ba5ee90d4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:00.125564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 594/1170] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:47:00.130856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:00.131275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:00.131407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:00.148377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:47:00.149597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:47:00.191223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:00.213307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1171] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:47:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:47:00.237515 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0616d-4cd8-4f3e-bcd1-e79ba5ee90d4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:00.304507 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:00.334524 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0616d-4cd8-4f3e-bcd1-e79ba5ee90d4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:00.367280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:00.368802 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:00.369067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:00.369335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] PATH_INFO: `/v3/domains/4c269ca7102e4492a7bd472863004d6e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:00.379346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c269ca7102e4492a7bd472863004d6e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:00.380752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42697c-3c68-4443-959b-c93281c5c2c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:00.382333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 595/1172] 10.222.0.10 () {56 vars in 1183 bytes} [Fri Jun 10 12:47:00 2022] GET /identity/v3/domains/4c269ca7102e4492a7bd472863004d6e => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:00.388127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:00.482956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abc5b2-4526-441e-b9ac-231f3c5eddb2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:00.516477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:00.517147 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:00.517429 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:00.517702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:00.518411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:00.519823 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270f4b1-5210-4af9-82b6-741d1215cdbe None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:00.607047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1173] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:47:00 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 12:47:02.783627 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0df9-df26-49e2-9d88-183bac7c8062 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:02.784162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0df9-df26-49e2-9d88-183bac7c8062 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:02.784162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece0df9-df26-49e2-9d88-183bac7c8062 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:02.785595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 596/1174] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:47:02.791230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:02.791649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:02.791778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:02.808908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:47:02.810081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:47:02.832644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:02.874882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1175] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:47:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:47:02.900106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0df9-df26-49e2-9d88-183bac7c8062 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:02.997528 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece0df9-df26-49e2-9d88-183bac7c8062 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:03.024785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:03.030249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:03.031093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:03.031377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:03.031654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] PATH_INFO: `/v3/domains/4c269ca7102e4492a7bd472863004d6e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:03.032845 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c269ca7102e4492a7bd472863004d6e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:03.034280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157e59b-9953-4b76-8554-24a91502e56e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:03.035866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 597/1176] 10.222.0.10 () {56 vars in 1183 bytes} [Fri Jun 10 12:47:02 2022] GET /identity/v3/domains/4c269ca7102e4492a7bd472863004d6e => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:03.041569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:03.137252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4130d-f884-4e75-bf94-94fb38f0caae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:03.169970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:03.170623 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:03.170905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:03.171180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:03.171885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:03.173336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19524bae-a846-4f12-b0c9-bd60772cfc45 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:03.258181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1177] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:47:03 2022] POST /identity/v3/users => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:47:05.404074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d194-9d31-4d56-b838-c644f68c4e0b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:05.404681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d194-9d31-4d56-b838-c644f68c4e0b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:05.404681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d194-9d31-4d56-b838-c644f68c4e0b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:05.406019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 598/1178] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:47:05.411036 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:05.411419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:05.411598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:05.428085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:47:05.429298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:47:05.440057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:05.494463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1179] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:47:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:47:05.517263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87d194-9d31-4d56-b838-c644f68c4e0b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:05.617099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87d194-9d31-4d56-b838-c644f68c4e0b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:05.650935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:05.651709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:05.651997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:05.652275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:05.662035 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:47:05.670589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:47:05.671703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:47:05.672914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 599/1180] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:47:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:47:05.677663 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:05.773457 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f838edd-235b-48f6-ac99-73456df6ded6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:05.806989 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:05.807643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:05.807927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:05.808206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:05.808977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:47:05.809284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:05.810642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:05.818363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1181] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:47:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:05.823940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:05.879596 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:05.920744 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d8c5f-db54-40d8-889a-d398cf56518f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:05.952229 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:05.953104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:05.953388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:05.953659 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] PATH_INFO: `/v3/users/74f97dc3bfb34577a7e194b072f7f4d5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:05.966626 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] RBAC: Authorizing `identity:get_user(user_id=74f97dc3bfb34577a7e194b072f7f4d5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:05.968045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:05.969675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 600/1182] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:47:05 2022] GET /identity/v3/users/74f97dc3bfb34577a7e194b072f7f4d5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:05.975359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:05.987087 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:06.072452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a82a4-aa4a-4cb6-b995-9a20882d629a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:06.105066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:06.105693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:06.105975 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:06.106250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:06.170263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:06.171737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:06.181605 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:06.265915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1183] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:47:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:47:06.272010 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:06.367180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb51d32-da36-4484-af74-32dcfa1c1290 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:06.383151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:06.399583 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:06.400415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:06.400730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:06.401006 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] PATH_INFO: `/v3/projects/c9b514183ffc40e59db53a189848e9c2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:06.402161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] RBAC: Authorizing `identity:get_project(project_id=c9b514183ffc40e59db53a189848e9c2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:06.403578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9f5d-9c82-4955-a500-52875dcb16a7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:06.405264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 601/1184] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:47:06 2022] GET /identity/v3/projects/c9b514183ffc40e59db53a189848e9c2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:06.411235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:06.508439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c851af1-55ad-4aee-88aa-ff2a7dd8b991 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:06.517441 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:06.541787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:06.542432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:06.542718 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:06.542994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:06.543850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=c9b514183ffc40e59db53a189848e9c2, user.id=74f97dc3bfb34577a7e194b072f7f4d5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:47:06.544163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:06.545876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf223fd-fcc3-4e85-a5dc-9863fbb9ab4b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:06.551163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1185] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:47:06 2022] GET /identity/v3/role_assignments?user.id=74f97dc3bfb34577a7e194b072f7f4d5&scope.project.id=c9b514183ffc40e59db53a189848e9c2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:08.657508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085daa9-fe88-446e-bd20-c72f3b2efb7c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:08.658001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085daa9-fe88-446e-bd20-c72f3b2efb7c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:08.658109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085daa9-fe88-446e-bd20-c72f3b2efb7c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:08.659422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 602/1186] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:47:08.665286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:08.665674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:08.665996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:08.683301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:47:08.684476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:47:08.748853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1187] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:47:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:47:08.771321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085daa9-fe88-446e-bd20-c72f3b2efb7c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:08.869308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085daa9-fe88-446e-bd20-c72f3b2efb7c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:08.902004 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:08.902772 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:08.903049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:08.903318 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:08.912906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:47:08.921143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:47:08.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:47:08.923241 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 603/1188] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:47:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:47:08.928233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:09.022521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e58fc7-129c-494c-b332-91423a8447ff None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:09.024477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:09.056633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:09.057331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:09.057610 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:09.057880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:09.058611 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:47:09.058912 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:09.060288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:09.067922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1189] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:47:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:09.074130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:09.118648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:09.171195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294353ff-5de2-443e-b04d-7e402fb1b7af None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:09.203035 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:09.203886 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:09.204162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:09.204430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] PATH_INFO: `/v3/users/74f97dc3bfb34577a7e194b072f7f4d5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:09.205618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] RBAC: Authorizing `identity:get_user(user_id=74f97dc3bfb34577a7e194b072f7f4d5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:09.207032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:09.208635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 604/1190] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:47:09 2022] GET /identity/v3/users/74f97dc3bfb34577a7e194b072f7f4d5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:09.215020 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:09.312866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b30b15-8b41-4d2e-8452-bbc9f002d1a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:09.346089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:09.346944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:09.347231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:09.347507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] PATH_INFO: `/v3/projects/c9b514183ffc40e59db53a189848e9c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:09.348701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] RBAC: Authorizing `identity:get_project(project_id=c9b514183ffc40e59db53a189848e9c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:09.350125 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829aa3d-4d6a-40f2-b986-02c7d4b2e963 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:09.351786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1191] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:47:09 2022] GET /identity/v3/projects/c9b514183ffc40e59db53a189848e9c2 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:09.357685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:09.453812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ebc6-5248-4ba9-9828-c810f04ece06 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:09.466209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:09.486106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:09.486975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:09.487253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:09.487524 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] PATH_INFO: `/v3/projects/c9b514183ffc40e59db53a189848e9c2/users/74f97dc3bfb34577a7e194b072f7f4d5/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:09.489444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=c9b514183ffc40e59db53a189848e9c2, user_id=74f97dc3bfb34577a7e194b072f7f4d5, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:09.490985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408b325-99d1-4bde-a224-5d2dff0d0b0a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:09.566218 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 605/1192] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:47:09 2022] PUT /identity/v3/projects/c9b514183ffc40e59db53a189848e9c2/users/74f97dc3bfb34577a7e194b072f7f4d5/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:47:11.636677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f09d9-b101-47fb-83fc-27d5d49da89a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:11.637117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f09d9-b101-47fb-83fc-27d5d49da89a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:11.637241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f09d9-b101-47fb-83fc-27d5d49da89a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:11.638617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1193] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:47:11.643821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:11.644200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:11.644389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:11.660913 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:47:11.662101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:47:11.727940 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 606/1194] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:47:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:47:11.752148 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f09d9-b101-47fb-83fc-27d5d49da89a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:11.782800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:11.850347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f09d9-b101-47fb-83fc-27d5d49da89a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:11.884542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:11.885287 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:11.885568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:11.885838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:11.895499 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:47:11.903524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:47:11.904639 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:47:11.905811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1195] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:47:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:47:11.910822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:12.005560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2a9d7-6fc3-458d-bdbf-5d48a4eb74a1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:12.007019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:12.038391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:12.039046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:12.039331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:12.040207 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:12.041124 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:47:12.041734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:12.043088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:12.051355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 607/1196] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:47:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:12.056868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:12.144371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:12.153178 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68429777-a3b1-4218-8ac7-5df8ebcf43d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:12.186380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:12.187227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:12.187511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:12.187789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] PATH_INFO: `/v3/users/74f97dc3bfb34577a7e194b072f7f4d5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:12.188978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=74f97dc3bfb34577a7e194b072f7f4d5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:12.190397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:12.191978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1197] 10.222.0.10 () {56 vars in 1177 bytes} [Fri Jun 10 12:47:12 2022] GET /identity/v3/users/74f97dc3bfb34577a7e194b072f7f4d5 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:12.197639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:12.292906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507a0c2-de52-4c61-87d6-d773a2f79714 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:12.326420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:12.327044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:12.327329 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:12.327603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:12.356825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:12.393120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:12.394603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:12.486854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 608/1198] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:47:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 10 12:47:12.493333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:12.587368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465dc3e-51e2-4c73-883f-29f13a8ec1f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:12.621077 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:12.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:12.622205 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:12.622477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] PATH_INFO: `/v3/projects/c9b514183ffc40e59db53a189848e9c2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:12.623634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] RBAC: Authorizing `identity:get_project(project_id=c9b514183ffc40e59db53a189848e9c2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:12.625084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9fe1e-3412-40a0-a200-f17d1e95551f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:12.626739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1199] 10.222.0.10 () {56 vars in 1186 bytes} [Fri Jun 10 12:47:12 2022] GET /identity/v3/projects/c9b514183ffc40e59db53a189848e9c2 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:12.632722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:47:12.691496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:12.728267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061074b-c84c-48b8-a2c3-7cc8bb7d0998 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:47:12.759559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:47:12.760191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:47:12.760471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:47:12.760770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:47:12.761584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=c9b514183ffc40e59db53a189848e9c2, user.id=74f97dc3bfb34577a7e194b072f7f4d5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:47:12.761891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:47:12.763296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712fed2-4433-4b90-9f90-f07a4d5f9870 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:47:12.768930 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 609/1200] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:47:12 2022] GET /identity/v3/role_assignments?user.id=74f97dc3bfb34577a7e194b072f7f4d5&scope.project.id=c9b514183ffc40e59db53a189848e9c2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:47:22.617198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:47:22.766321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=36 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:28.434751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea2f-e2d3-4537-a586-aebf836d1913 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:28.435359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea2f-e2d3-4537-a586-aebf836d1913 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:28.435359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ea2f-e2d3-4537-a586-aebf836d1913 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:28.436674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1201] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:28.441921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:28.442333 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:28.442484 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:28.459599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:28.460813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:28.525224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 610/1202] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:28.549713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ea2f-e2d3-4537-a586-aebf836d1913 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:28.652209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ea2f-e2d3-4537-a586-aebf836d1913 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:28.686483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:28.687210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:28.687495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:28.687778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:28.697926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:28.699464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:28.716845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:28.717976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:28.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:28.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:28.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:28.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:28.718939 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1203] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:28.724337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:28.821288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672cad-4fdb-4362-8a1d-a559f618c84d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:28.848165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:28.854292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:28.854987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:28.855271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:28.855564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:28.856260 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:28.856566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:28.857956 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc38f5a-cfe8-4302-a415-fcf6e0e910ad None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:28.868639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 611/1204] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:28.874775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:28.927910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:28.975811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7dd91-2f9c-4221-a457-d1b616ff1dd1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:29.010245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:29.011249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:29.011538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:29.011818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:29.012514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:29.013977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6b299-0e3a-46e4-99de-6002b117b739 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:29.200307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1205] 10.222.0.10 () {60 vars in 1132 bytes} [Fri Jun 10 12:48:28 2022] POST /identity/v3/users => generated 251 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:48:31.331752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdedb41-33c5-4c04-95d6-651bedca2c93 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:31.332338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdedb41-33c5-4c04-95d6-651bedca2c93 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:31.332338 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdedb41-33c5-4c04-95d6-651bedca2c93 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:31.333766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 612/1206] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:31.339113 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:31.339628 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:31.339628 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:31.356521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:31.359109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:31.423609 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1207] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:31.447536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdedb41-33c5-4c04-95d6-651bedca2c93 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:31.546745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdedb41-33c5-4c04-95d6-651bedca2c93 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:31.579906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:31.580712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:31.580998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:31.581272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:31.596324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:31.598895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:31.600059 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:31.601176 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 613/1208] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:48:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:31.606121 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:31.646353 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:31.703979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5101a-e8b6-4fd0-bc91-466ff7c896bf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:31.736868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:31.737528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:31.737843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:31.738119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:31.738935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:31.739247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:31.740640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:31.749135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1209] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:48:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:31.754836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:31.803874 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:31.851263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad988e1-d667-4010-8f12-38e336d1ec74 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:31.884221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:31.885027 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:31.885337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:31.885611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:31.895849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:31.897353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:31.913857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:31.914919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:31.916187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:31.916187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:31.916187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:31.916187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:31.916187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 614/1210] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:31.921782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.015917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:32.018682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17068be5-8b4a-4912-ae4e-a88d94dae70a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.052347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.053042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.053312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.053585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.054300 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:32.054605 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.055965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:32.067161 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1211] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:32.072732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.170585 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b9193-5808-47fe-af86-677731cdc1a5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.172084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:32.203345 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.204141 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.208764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.208764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.211445 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.212924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:32.227465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:32.228682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:32.232642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 615/1212] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:32.234667 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.333943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de6ca7-bcdb-48e6-9c2f-e490ac76de0c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.366298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.366957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.367239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.367513 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.368342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:32.368670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.370703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:32.392362 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1213] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:32.393653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.489591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566341b1-9f41-441b-806b-1221f8c68ff4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.522258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.522884 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.523163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.523432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.552904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:32.589566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.591005 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:32.688755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 616/1214] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:48:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:48:32.694508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.713117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:32.791234 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db62669-547d-4855-9860-d4c58e2e99f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.824276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.825080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.825359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.825631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.835342 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.836794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:32.854782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:32.855870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:32.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:32.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:32.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:32.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:32.857130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1215] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:32.861736 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:32.921123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:32.957732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf7b76-53c2-4bb9-a415-eba8f7d09d99 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:32.991285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:32.991943 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:32.992222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:32.992492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:32.993234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:32.993535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:32.995073 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:33.006475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 617/1216] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:33.012072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:33.079877 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:33.109377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8051-d8c4-49c3-bf13-cbe7eeb2c0ab None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:33.142923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:33.143965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:33.144304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:33.145013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:33.152679 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:33.154107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:33.168312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:33.169698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:33.170925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1217] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:33.175686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:33.272818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed57f-5995-4346-9f4c-8cc310fea7ff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:33.295690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:33.306748 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:33.308298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:33.308598 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:33.308912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:33.309699 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:33.310012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:33.311431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8eba4-751c-4dbf-a21a-76cc63c4ee50 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:33.322603 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 618/1218] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 12:48:33.328636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:33.426839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628da6e-b3c9-402a-99c4-cc49cfccd20c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:33.454804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:33.460288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:33.460982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:33.461267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:33.461543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:33.462359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=9ab4d412e09a4d68b47bc2d360380fe2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:33.462669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:33.464264 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d46a4b-2de8-4370-92fd-de1d64c88b09 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:33.469542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1219] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:48:33 2022] GET /identity/v3/role_assignments?user.id=9ab4d412e09a4d68b47bc2d360380fe2&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:35.532919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c329-758a-45d2-b745-6902037d70a6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:35.533474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c329-758a-45d2-b745-6902037d70a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:35.533474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54c329-758a-45d2-b745-6902037d70a6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:35.534835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 619/1220] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:35.539911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:35.540321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:35.540465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:35.558797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:35.560000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:35.625142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1221] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:35.647417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54c329-758a-45d2-b745-6902037d70a6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:35.750807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54c329-758a-45d2-b745-6902037d70a6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:35.783936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:35.784675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:35.784959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:35.785231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:35.795847 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:35.803447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:35.806321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:35.807305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 620/1222] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:48:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:35.811221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:35.908024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071daa-1484-4256-b7b6-d0a874d1d947 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:35.931743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:35.942102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:35.942763 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:35.943047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:35.943319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:35.944058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:35.944363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:35.945772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:35.953494 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1223] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:48:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:35.959146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.002103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:36.057651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85ca3f-f4b3-4ed9-ab83-aae658fb9147 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.089875 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.090642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.090924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.091199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.101468 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.102892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:36.120074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:36.123236 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:36.124349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:36.124349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:36.124349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:36.124349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:36.124349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 621/1224] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:36.126986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.225635 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd5af4-dd14-4bd4-9649-203b9b00c016 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.257814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.258460 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.258741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.259014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.259721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:36.260021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.261908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.273327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1225] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:36.279759 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.372349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:36.378896 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bda144-5bd1-460a-84c7-5e25f1702aef None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.412765 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.413557 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.413839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.414157 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.421573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.422998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:36.437262 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:36.438906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:36.440108 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 622/1226] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:36.444343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.490373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:36.542225 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2a6ba-92e0-4feb-a0c0-7ecb95078c2d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.576807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.577465 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.577735 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.578004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.578820 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:36.579122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.580528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.596839 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1227] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:36.602516 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.701925 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f25a2c-f0bb-4a8c-965c-1582e269843e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.735043 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.735829 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.736109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.736380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.746743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.748162 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:36.765453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:36.766504 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:36.767640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:36.767640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:36.767640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:36.767640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:36.767640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 623/1228] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 10 12:48:36.772396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.870859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277cf9e-6544-4708-9db9-8bbdc483da14 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:36.873188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:36.903933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:36.904594 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:36.904910 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:36.905187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:36.905898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:36.906203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:36.907560 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:36.919268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1229] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:36.925082 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:36.934443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:37.025707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925b999-a5c4-4d21-94be-f7470d6bb507 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:37.059613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:37.060392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:37.060711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:37.060987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:37.067380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:37.068840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:37.082156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:37.083821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:37.085554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 624/1230] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:37.089243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:37.187059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cdc51-a330-4f3f-8dd9-3aeadfac53d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:37.221387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:37.222080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:37.222361 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:37.222633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:37.223406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:37.223710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:37.225174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10cfc6-387a-445c-9f37-c72bf5e883a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:37.237417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1231] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:37.243304 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:37.309489 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:37.343662 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31902a13-7273-4458-8f13-bf7381d112ae None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:37.375961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:37.376855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:37.377141 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:37.377414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/9ab4d412e09a4d68b47bc2d360380fe2/roles/88e4d798c2964b2dbc99651fe66fdb0e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:37.390989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=9ab4d412e09a4d68b47bc2d360380fe2, role_id=88e4d798c2964b2dbc99651fe66fdb0e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:37.392464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8627dc-0dbc-4743-9117-9c618b02e83e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:37.503283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 625/1232] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:48:37 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/9ab4d412e09a4d68b47bc2d360380fe2/roles/88e4d798c2964b2dbc99651fe66fdb0e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:48:39.591310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046c13-0bec-4472-8c43-4615b6e6b3da None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:39.591857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046c13-0bec-4472-8c43-4615b6e6b3da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:39.591857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62046c13-0bec-4472-8c43-4615b6e6b3da None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:39.593250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1233] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:39.598469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:39.598941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:39.599056 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:39.616500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:39.617730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:39.686621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 626/1234] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:39.709768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046c13-0bec-4472-8c43-4615b6e6b3da None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:39.735541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:39.809542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62046c13-0bec-4472-8c43-4615b6e6b3da None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:39.842994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:39.843707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:39.843984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:39.844254 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:39.854670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:39.862604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:39.863545 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:39.868822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1235] 10.222.0.10 () {56 vars in 1102 bytes} [Fri Jun 10 12:48:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:39.870073 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:39.915817 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:39.966153 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74d6c5-9c83-4dec-a0ef-41d72f180e5f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:39.998754 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:39.999409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:39.999694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:39.999972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.000740 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:40.001049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.002432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.010559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 627/1236] 10.222.0.10 () {56 vars in 1103 bytes} [Fri Jun 10 12:48:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:40.018107 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:40.099483 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:40.114423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e07a98e-d970-48ce-9dd3-0722f5525a34 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:40.148061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:40.148872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:40.149159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:40.149434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.160167 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.161657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:40.179852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:40.182246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:40.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:40.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:40.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:40.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:40.183390 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1237] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:40.186775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:40.287743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3e037-0ece-4525-9621-2d8846c42466 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:40.297045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:40.321879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:40.322544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:40.323594 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:40.324003 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.324755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:40.325094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.326455 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.337838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 628/1238] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:40.343511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:40.444146 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526c1c2c-32f0-47c1-82b1-a8f66f6ef11b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:40.477764 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:40.478548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:40.478859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:40.479159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.481802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:40.486365 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.487807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:40.502669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:40.505755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:40.506945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1239] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:40.509673 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:40.607185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0a3c2-e150-40ee-b9ef-48d9f0f52c48 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:40.641578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:40.642243 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:40.642527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:40.642799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.643619 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:40.643928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.645375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.661755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 629/1240] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:40.668018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:40.767633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac8563-3c9e-4632-9934-4f4f21caa2ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:40.802792 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:40.803432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:40.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:40.803988 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:40.864717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:40.872172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:40.873678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:40.968785 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1241] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:48:40.974613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:41.001961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:41.075390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea21ca-bf13-4f43-ad46-fc3c937c6aa3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:41.108047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:41.108982 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:41.109263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:41.109535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:41.119199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:41.120686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:41.137849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:41.139809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:41.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:41.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:41.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:41.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:41.140958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 630/1242] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:41.145164 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:41.238175 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:41.243902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798860c0-c738-4e5d-8309-450fbcb58af8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:41.278505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:41.279186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:41.279473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:41.279751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:41.280467 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:41.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:41.282181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:41.294917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1243] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:41.300534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:41.378405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:41.399085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2e424-39a5-4e55-a1f5-e635b059b00b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:41.433968 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:41.434745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:41.435026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:41.435296 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:41.441878 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:41.443309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:41.457519 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:41.458579 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:41.459666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 631/1244] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:41.465415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:41.563348 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10ce61-4677-4340-aeb7-21d94e6b6ed4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:41.596336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:41.597011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:41.597298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:41.597576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:41.598364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:41.598675 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:41.600100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15704c6d-74f4-4dd4-8874-37616131005e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:41.612846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1245] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:41.618720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:41.716643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81a0d-9ccd-45fc-92bf-05e80ba9cb64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:41.748609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:41.749276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:41.749562 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:41.749839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:41.750661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] RBAC: Adding query filter params (role.id=88e4d798c2964b2dbc99651fe66fdb0e, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=9ab4d412e09a4d68b47bc2d360380fe2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:41.750976 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:41.752402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7373235-c137-4250-943b-cf8d55e85821 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:41.758122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 632/1246] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:48:41 2022] GET /identity/v3/role_assignments?user.id=9ab4d412e09a4d68b47bc2d360380fe2&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=88e4d798c2964b2dbc99651fe66fdb0e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:43.901361 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a56e-e429-482e-966f-481c5f2e48bc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:43.901870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a56e-e429-482e-966f-481c5f2e48bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:43.901870 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65a56e-e429-482e-966f-481c5f2e48bc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:43.903181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1247] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:48:43.908390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:43.908870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:43.908980 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:43.913975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:43.926527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:43.927708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:43.991358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 633/1248] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:44.015453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a56e-e429-482e-966f-481c5f2e48bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.033632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:44.114318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65a56e-e429-482e-966f-481c5f2e48bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.146274 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.147052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.147328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.147595 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.159041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:44.166863 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:44.168109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:44.169295 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1249] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:44.174457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.271102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0c68a-a551-40b2-a5f9-9654e44f47cf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.300396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:44.305340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.305999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.306283 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.306568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.307509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:44.307888 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:44.309297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:44.317178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 634/1250] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:44.323316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.399137 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:44.421510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3d72e-2b23-4230-95b2-d5d5627053a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.453778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.454548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.455096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.466116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:44.467548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:44.483888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:44.485262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:44.486336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:44.486336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:44.486336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:44.486336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:44.486336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1251] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:44.490936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.589218 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309eb79-133a-4eeb-b820-3dfe73847f85 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.621771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.622422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.622694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.622971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.623674 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:44.623979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:44.625366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:44.637399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 635/1252] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:44.643216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.740602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e341c11-6da2-4dc5-bdc6-73a9e1cbad48 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.765776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:44.773294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb698-7935-445f-851a-89356ab67126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.774086 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb698-7935-445f-851a-89356ab67126 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.774366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb698-7935-445f-851a-89356ab67126 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.774640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feb698-7935-445f-851a-89356ab67126 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.782489 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb698-7935-445f-851a-89356ab67126 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:44.783915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feb698-7935-445f-851a-89356ab67126 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-28feb698-7935-445f-851a-89356ab67126 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:44.798224 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:44.799350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:44.800688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1253] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:44.805187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:44.859316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:44.901768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6a78-d629-41ae-8fb3-5e37a67a1732 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:44.934404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:44.935065 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:44.935371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:44.935651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:44.936474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:44.936811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:44.938231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:44.955751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 636/1254] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:44.961516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb698-7935-445f-851a-89356ab67126 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.059524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feb698-7935-445f-851a-89356ab67126 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:45.092908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:45.093544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:45.093826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:45.094108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:45.149001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:45.160999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:45.162448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:45.256405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1255] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:48:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 10 12:48:45.262206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.359216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580c3-e2e9-4edb-92fe-ac90b25470c8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:45.372586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:45.392384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:45.393227 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:45.393502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:45.393783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:45.403502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:45.405095 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:45.423050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:45.424092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:45.425219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:45.425219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:45.425219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:45.425219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:45.425219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 637/1256] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:45.429935 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.514911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:45.526727 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d53de-07ea-49e0-924d-e5daa714f8a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:45.559754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:45.560420 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:45.560732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:45.561089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:45.561819 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:45.562124 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:45.563487 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:45.575058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1257] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:45.580952 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.679309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b43577-5f05-4583-866c-460fd04ad723 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:45.711612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:45.712391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:45.712714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:45.712990 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:45.719939 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:45.721399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:45.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:45.737548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:45.738631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 638/1258] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:45.742423 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.840157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6164a52-0d4c-421e-b1e3-51c1da206f51 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:45.873160 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:45.873775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:45.874028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:45.874298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:45.875069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:45.875375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:45.876812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b81a00-2a7a-4623-85ca-747257052e02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:45.889150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1259] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:45.895086 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:45.920989 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:45.991670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06bbf0-610a-4573-b9cf-dfe61d98648e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:46.024910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:46.026096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:46.026395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:46.026672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:46.027492 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=9ab4d412e09a4d68b47bc2d360380fe2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:46.027807 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:46.029252 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be5db4-9866-46d4-9e8f-38479360eb1d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:46.034565 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 639/1260] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:48:45 2022] GET /identity/v3/role_assignments?user.id=9ab4d412e09a4d68b47bc2d360380fe2&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:48.113444 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a571-cc7d-4e7a-87a8-2bdcb467fb7c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.114011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a571-cc7d-4e7a-87a8-2bdcb467fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.114011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5a571-cc7d-4e7a-87a8-2bdcb467fb7c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.115369 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1261] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:48.120447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.120922 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.121016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.138284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:48.139464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:48.205582 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 640/1262] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:48.228654 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5a571-cc7d-4e7a-87a8-2bdcb467fb7c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:48.239536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:48.327096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5a571-cc7d-4e7a-87a8-2bdcb467fb7c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:48.360782 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:48.361553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.361831 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.362103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.372080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:48.379637 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:48.380861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:48.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1263] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:48:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:48.387763 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:48.406402 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:48.483195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ba908-0271-489e-b95e-84e62fb9b94d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:48.517023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:48.517686 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.517973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.518250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.518999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:48.519310 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:48.520715 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:48.529397 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 641/1264] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:48:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:48.535249 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:48.600803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:48.634907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc23004-4511-4299-9280-3b5dc2c1e851 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:48.667573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:48.668655 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.669363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.669662 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.681112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:48.683066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:48.700313 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:48.701477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:48.702776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:48.702776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:48.702776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:48.702776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:48.702776 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1265] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:48.707370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:48.786376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:48.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b738b0-2746-4f7f-98b1-e11f13128197 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:48.837653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:48.838303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.838591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.839045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.839688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:48.840089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:48.841481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:48.852548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 642/1266] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:48.858063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:48.957553 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b105e8-a87a-4354-9837-0fe33b1cc9c2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:48.976351 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:48.990502 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:48.991292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:48.991572 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:48.991844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:48.999793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.001258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:49.014942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:49.015950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:49.016927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1267] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:49.021876 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.120770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd15ad2-9a97-429f-a3e1-be6c63b73eb8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.153548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.154211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.154498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.154911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.156045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:49.156357 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.157810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.166739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:49.174939 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 643/1268] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:49.180744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.282980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fcef7-5d54-4612-9e0f-6efec5e8d0b3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.316608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.317413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.317697 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.317972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.329301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.330766 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:49.348695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:49.362055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:49.363243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:49.363243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:49.363243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:49.363243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:49.363243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1269] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:49.363584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.455174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adccfaf-e347-4cb6-88b2-62fa4fdd466b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.487213 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.487863 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.488143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.488413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.489148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:49.489449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.490823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.502404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 644/1270] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:49.507938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.539135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:49.604902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84e2bd-a692-48a0-8df1-ec446d7f4cc0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.638633 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.639419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.639703 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.639977 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.646446 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.647881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:49.661791 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:49.662891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:49.664023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1271] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:49.670258 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.727867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:49.769271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcbc24-a7f0-47df-b307-6d5eabd20030 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.802701 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.803281 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.803564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.803844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.804642 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:49.804957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.806571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894ab5f-2824-4039-ab8e-706bcc3faa08 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:49.818692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 645/1272] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:49.824840 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:49.912922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:49.922261 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74533-7ed5-4741-9fbc-7b4dc13db68d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:49.955272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:49.956169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:49.956447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:49.956748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] PATH_INFO: `/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/9ab4d412e09a4d68b47bc2d360380fe2/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:49.958638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=75b18d98ed7f4fcdb5001b74fbb99db2, user_id=9ab4d412e09a4d68b47bc2d360380fe2, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:49.960106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee817cae-76a9-4f7c-a0b5-cef553ffe7a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:50.086629 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1273] 10.222.0.10 () {58 vars in 1439 bytes} [Fri Jun 10 12:48:49 2022] PUT /identity/v3/projects/75b18d98ed7f4fcdb5001b74fbb99db2/users/9ab4d412e09a4d68b47bc2d360380fe2/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 12:48:52.180072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878925-32af-438d-b991-ebeb65b7d3eb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.180649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878925-32af-438d-b991-ebeb65b7d3eb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.180649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59878925-32af-438d-b991-ebeb65b7d3eb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.183286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 646/1274] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:48:52.188347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.188796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.188933 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.204800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:52.206003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:52.271807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1275] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:52.296114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878925-32af-438d-b991-ebeb65b7d3eb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:52.397409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59878925-32af-438d-b991-ebeb65b7d3eb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:52.414372 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:52.431577 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:52.432593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.432907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.433204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.445574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 10 12:48:52.450559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:52.451644 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:52.452806 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 647/1276] 10.222.0.10 () {56 vars in 1096 bytes} [Fri Jun 10 12:48:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:52.457833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:52.536889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:52.554671 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea355167-f988-4db9-b14a-9b15e791484c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:52.586669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:52.587334 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.587769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.588740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.589540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:52.589848 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:52.591219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:52.599163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1277] 10.222.0.10 () {56 vars in 1099 bytes} [Fri Jun 10 12:48:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:52.605835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:52.704407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8566130-544c-4ba8-9add-4216b7ad1a0b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:52.737044 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:52.737821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.738101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.738371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.748612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:52.750064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:52.766959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:52.768012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:52.769314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:52.769314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:52.769314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:52.769314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:52.769314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 648/1278] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:52.773904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:52.873662 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d877b1dc-0898-4682-b206-1ad9a0258e15 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:52.906904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:52.907590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:52.907891 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:52.908166 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:52.908896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:52.909195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:52.910546 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:52.922240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1279] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:52.927825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:52.957958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:53.028869 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28dde4-0c29-46e8-91ca-4c4706d629d0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:53.062038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:53.062836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:53.063116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:53.063389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:53.070221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:53.071645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 10 12:48:53.086353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:53.087500 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:53.088957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 649/1280] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:53.093601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:53.097519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:53.196881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7ef86-d8d9-46cd-839f-0161ffbe0c27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:53.230425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:53.231023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:53.231302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:53.231571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:53.232400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:53.232736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:53.234207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:53.251426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1281] 10.222.0.10 () {56 vars in 1143 bytes} [Fri Jun 10 12:48:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:53.257421 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:53.347020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:53.356396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811b269-ae54-466b-9a30-1448d36a73a4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:53.391721 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:53.392371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:53.392685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:53.392969 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:53.461068 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:53.462599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:53.549399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:53.559839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 650/1282] 10.222.0.10 () {58 vars in 1282 bytes} [Fri Jun 10 12:48:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 10 12:48:53.565892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:53.626378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:53.664583 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9bb7c-6aef-4d66-aaac-05321fb2e051 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:53.698167 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:53.698949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:53.699229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:53.699504 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:53.710005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:53.712057 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 10 12:48:53.730237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:53.731897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:53.733632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 10 12:48:53.733632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 10 12:48:53.733632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 10 12:48:53.733632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:53.733632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1283] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:48:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:53.737218 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:53.833799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdc41e-74c0-46cb-8e08-372546704c2c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:53.869439 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:53.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:53.870574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:53.870853 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:53.871567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:53.871876 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:53.873336 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:53.884112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 651/1284] 10.222.0.10 () {56 vars in 1109 bytes} [Fri Jun 10 12:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:53.890041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:53.988296 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950becb-07b1-4401-940b-36db563e0064 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:54.002117 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:54.022198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:54.022932 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:54.023211 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:54.023484 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:54.030155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:54.031582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 10 12:48:54.045617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:54.052867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: ERROR keystone.server.flask.application Jun 10 12:48:54.053998 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1285] 10.222.0.10 () {56 vars in 1111 bytes} [Fri Jun 10 12:48:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:54.054597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:54.103919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:54.152149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7027a-acfb-408b-b56e-0b567b2f20b9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:54.186555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:54.187203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:54.187486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:54.187761 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:54.188539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:54.188882 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:54.190298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010cfc5-ac96-46b4-a944-51956f28eb7f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:54.201859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 652/1286] 10.222.0.10 () {56 vars in 1148 bytes} [Fri Jun 10 12:48:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:54.207942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:54.306164 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeebbdf-550f-4f00-abf4-e3021ee866ac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:54.338950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:54.339584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:54.339861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:54.340131 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:54.340976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] RBAC: Adding query filter params (role.id=0e72028c9daf424e8cf295e12a9e4109, scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2, user.id=9ab4d412e09a4d68b47bc2d360380fe2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:54.341284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:54.342738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8aca0-bcc8-4d52-9919-0404ac20c0ab None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:54.348412 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1287] 10.222.0.10 () {56 vars in 1374 bytes} [Fri Jun 10 12:48:54 2022] GET /identity/v3/role_assignments?user.id=9ab4d412e09a4d68b47bc2d360380fe2&scope.project.id=75b18d98ed7f4fcdb5001b74fbb99db2&role.id=0e72028c9daf424e8cf295e12a9e4109 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:56.480206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680491-a6e7-43e1-bfef-606931c3427c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:56.480867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680491-a6e7-43e1-bfef-606931c3427c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:56.480867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da680491-a6e7-43e1-bfef-606931c3427c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:56.482185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 653/1288] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:56.487188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:56.490220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:56.490220 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:56.504102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:56.505307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:56.534589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:56.570163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1289] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:56.593628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680491-a6e7-43e1-bfef-606931c3427c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:56.694084 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da680491-a6e7-43e1-bfef-606931c3427c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:56.707628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:56.733135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:56.733866 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:56.734148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:56.734424 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:56.735073 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:56.736426 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:48:56.748549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:48:56.749928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:48:56.751046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 654/1290] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:48:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:48:56.755758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:56.851514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1b2fd-0e21-42f1-bd58-ad4a34a0cbfc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:56.884568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:56.885908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:56.886189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:56.886466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:56.887164 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:56.887469 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:56.888856 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bde50-383a-4261-bd54-4beeebdf2155 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:56.893670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1291] 10.222.0.10 () {56 vars in 1116 bytes} [Fri Jun 10 12:48:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:56.899450 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:56.996534 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b724bf-3d40-4631-8add-f77f4eee5ef1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:57.029648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc070658-3636-435c-8649-48da180a2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:57.030292 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070658-3636-435c-8649-48da180a2576 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:57.030571 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070658-3636-435c-8649-48da180a2576 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:57.030842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070658-3636-435c-8649-48da180a2576 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:57.031530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc070658-3636-435c-8649-48da180a2576 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:48:57.031861 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc070658-3636-435c-8649-48da180a2576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:57.033255 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc070658-3636-435c-8649-48da180a2576 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:57.037532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 655/1292] 10.222.0.10 () {56 vars in 1116 bytes} [Fri Jun 10 12:48:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:48:59.132881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6043-d7c3-4eee-b913-69afeafbda67 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:59.133461 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6043-d7c3-4eee-b913-69afeafbda67 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:59.133461 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc6043-d7c3-4eee-b913-69afeafbda67 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:59.134806 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1293] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:48:59.140109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0d71-3200-4ed9-b5de-fdc84de3bd6e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:59.140531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0d71-3200-4ed9-b5de-fdc84de3bd6e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:59.140813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0d71-3200-4ed9-b5de-fdc84de3bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:59.157758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-89bd0d71-3200-4ed9-b5de-fdc84de3bd6e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:48:59.163641 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-89bd0d71-3200-4ed9-b5de-fdc84de3bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:48:59.189703 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:59.226743 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 656/1294] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:48:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:48:59.250169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6043-d7c3-4eee-b913-69afeafbda67 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:48:59.280669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:48:59.348850 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc6043-d7c3-4eee-b913-69afeafbda67 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:48:59.382044 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:48:59.382729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:48:59.383064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:48:59.383282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:48:59.383994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:48:59.386187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db31cf5-0302-4fd5-8c8f-cfc1fd94248e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:48:59.469923 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1295] 10.222.0.10 () {60 vars in 1141 bytes} [Fri Jun 10 12:48:59 2022] POST /identity/v3/services => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:49:01.601360 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc60b-3a19-48e1-9796-dbe83911325a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:01.601915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc60b-3a19-48e1-9796-dbe83911325a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:01.601915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cc60b-3a19-48e1-9796-dbe83911325a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:01.603306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 657/1296] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:49:01.609024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:01.609456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:01.609587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:01.626636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:49:01.627861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:49:01.699590 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1297] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:49:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:49:01.722821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cc60b-3a19-48e1-9796-dbe83911325a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:01.821195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cc60b-3a19-48e1-9796-dbe83911325a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:01.854906 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:01.855643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:01.855932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:01.856209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:01.856916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:01.858298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:49:01.870416 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:49:01.871569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:01.872606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 658/1298] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:49:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:49:01.877805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:01.896607 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:01.974761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ca25-2f8a-4784-919a-1cac86ac9ac4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:02.007479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:02.008138 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:02.008425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:02.008755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:02.011815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:49:02.011815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:02.011815 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:02.016799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1299] 10.222.0.10 () {56 vars in 1116 bytes} [Fri Jun 10 12:49:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:49:02.022751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:02.054401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:02.121033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf2d72-f94a-434b-80cc-942536b2f888 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:02.155391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:02.156066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:02.156351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:02.156658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:02.157438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] RBAC: Adding query filter params (interface=public, service_id=89079c964f0f4e3db11647c45f509090, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:49:02.157746 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:02.159232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a279c2-d2b0-4537-90d2-130db32c9d28 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:02.164267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 659/1300] 10.222.0.10 () {56 vars in 1251 bytes} [Fri Jun 10 12:49:02 2022] GET /identity/v3/endpoints?service_id=89079c964f0f4e3db11647c45f509090&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:49:02.170743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:02.250226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:02.267963 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e6b2e-9c28-4172-930c-91c6b2390e50 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:02.300018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:02.300687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:02.300973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:02.301246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:02.301964 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:02.303317 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8fad3-f949-4ff7-bfc0-ce0aca3c5406 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:02.310450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1301] 10.222.0.10 () {56 vars in 1087 bytes} [Fri Jun 10 12:49:02 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 12:49:04.399633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c82-87b6-4521-bc62-1b8799cf7d23 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:04.400214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c82-87b6-4521-bc62-1b8799cf7d23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:04.400214 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d5c82-87b6-4521-bc62-1b8799cf7d23 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:04.402221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 660/1302] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:49:04.407511 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889393-abc0-45da-b905-cd54304b524e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:04.407934 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889393-abc0-45da-b905-cd54304b524e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:04.408100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10889393-abc0-45da-b905-cd54304b524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:04.426033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-10889393-abc0-45da-b905-cd54304b524e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:49:04.427268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10889393-abc0-45da-b905-cd54304b524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:49:04.492415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1303] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:49:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 10 12:49:04.515576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d5c82-87b6-4521-bc62-1b8799cf7d23 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:04.610240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:04.616911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d5c82-87b6-4521-bc62-1b8799cf7d23 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:04.651133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:04.652130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:04.652415 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:04.652718 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:04.653390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:04.654755 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 10 12:49:04.666671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 10 12:49:04.667924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 10 12:49:04.669087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: ERROR keystone.server.flask.application Jun 10 12:49:04.670566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 661/1304] 10.222.0.10 () {56 vars in 1117 bytes} [Fri Jun 10 12:49:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 10 12:49:04.674061 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889393-abc0-45da-b905-cd54304b524e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:04.765925 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:04.788334 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10889393-abc0-45da-b905-cd54304b524e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:04.821318 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:04.821978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:04.822778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:04.823196 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:04.823984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 12:49:04.824292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:04.825721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de541860-941c-444d-b6bf-04cb17405ab1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:04.830681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1305] 10.222.0.10 () {56 vars in 1116 bytes} [Fri Jun 10 12:49:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 12:49:04.836488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:49:04.934040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c44d2-2ac9-44d8-95c8-2ea71805a7fe None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:49:04.967280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:49:04.967917 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:49:04.968198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:49:04.968469 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:49:04.969233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:49:04.970584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24609e-7206-46c3-b282-b8a1609e75a2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:49:05.046618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 662/1306] 10.222.0.10 () {60 vars in 1144 bytes} [Fri Jun 10 12:49:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 12:49:14.840400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=30 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:49:15.041757 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:20.225128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723c02-874e-4c21-87bf-d202a966483a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:20.226218 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723c02-874e-4c21-87bf-d202a966483a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:20.226631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c723c02-874e-4c21-87bf-d202a966483a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:20.234334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc22e7-2150-402e-91b7-9414769b9439 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:20.235233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc22e7-2150-402e-91b7-9414769b9439 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:20.235741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc22e7-2150-402e-91b7-9414769b9439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:20.239123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1307] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:20.326190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-66dc22e7-2150-402e-91b7-9414769b9439 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:20.327814 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-66dc22e7-2150-402e-91b7-9414769b9439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:20.501102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 663/1308] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:56:20.561657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:20.563497 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:20.565275 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:20.570364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1309] 10.222.0.10 () {54 vars in 964 bytes} [Fri Jun 10 12:56:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:20.581531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ba7b-7eb0-48d5-beab-7e1c861a3c60 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:20.583305 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ba7b-7eb0-48d5-beab-7e1c861a3c60 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:20.584841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19ba7b-7eb0-48d5-beab-7e1c861a3c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:20.749325 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-af19ba7b-7eb0-48d5-beab-7e1c861a3c60 None None] MFA Rules not processed for user `2fda4f42ba344b4f960ed39a006b887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:20.750883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-af19ba7b-7eb0-48d5-beab-7e1c861a3c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:20.774443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:20.846586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 664/1310] 10.222.0.10 () {58 vars in 1061 bytes} [Fri Jun 10 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:56:20.856355 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:20.858344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:21.073622 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf2aab-da9e-407b-944a-e46f523e9926 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:21.156982 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:21.157880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:21.158209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:21.158482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:21.160231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:21.224194 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:21.297463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:21.299177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7a4e5-3fec-4648-8e00-a43ccc8f7a2d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:21.322186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1311] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:23.789181 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:23.789766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:23.789766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:23.791127 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 665/1312] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:23.796383 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8783-db3f-47ab-b66d-a47ef0d597b1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:23.796822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8783-db3f-47ab-b66d-a47ef0d597b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:23.796988 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8783-db3f-47ab-b66d-a47ef0d597b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:23.866631 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-87ee8783-db3f-47ab-b66d-a47ef0d597b1 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:23.867749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-87ee8783-db3f-47ab-b66d-a47ef0d597b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:23.963896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1313] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:24.004927 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:24.006473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:24.117146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3075b-ef4e-4c6e-a7fa-2e1b305d215b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:24.194854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:24.197495 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:24.198142 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:24.198427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:24.198706 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:24.200497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:24.313233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:24.314676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2add6-f326-4a1b-b5c1-da9c08b5b070 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:24.333303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 666/1314] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:26.935184 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:26.935749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:26.935749 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:26.937149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1315] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:26.942371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9094c-c3b6-4a1c-8c20-dd3bdf33b878 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:26.942770 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9094c-c3b6-4a1c-8c20-dd3bdf33b878 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:26.942916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9094c-c3b6-4a1c-8c20-dd3bdf33b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:27.005209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-54a9094c-c3b6-4a1c-8c20-dd3bdf33b878 None None] MFA Rules not processed for user `8faceef41f5540618c0b0bd5ebe3f908`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:27.006405 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-54a9094c-c3b6-4a1c-8c20-dd3bdf33b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:27.057016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:27.099877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 667/1316] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:27.139981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:27.141646 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:27.151387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:27.249442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4cbc5-8a25-46f7-8ff8-15389715b00c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:27.352310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:27.352967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:27.353251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:27.353524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:27.355209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:27.428669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:27.479556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:27.481259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54328e6-8291-44ff-a467-005a935a1cda service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:27.501695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1317] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:30.438232 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:30.438871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:30.438871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:30.440152 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 668/1318] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:30.445355 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b14-d0d0-4292-9542-5d33ea39bce2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:30.445765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b14-d0d0-4292-9542-5d33ea39bce2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:30.445937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56837b14-d0d0-4292-9542-5d33ea39bce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:30.508913 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-56837b14-d0d0-4292-9542-5d33ea39bce2 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:30.510097 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-56837b14-d0d0-4292-9542-5d33ea39bce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:30.603571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1319] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:30.642208 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:30.643729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:30.743527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a5f3d-710c-43ff-8aad-16ae34a41900 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:30.813768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:30.814409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:30.814695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:30.814972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:30.816581 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:30.823862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:30.924371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:30.925852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6f539-db7e-450f-933e-678a3215338b service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:30.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 669/1320] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:34.130867 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40303e-b875-4916-b06a-9e57b68bd33a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:34.131428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40303e-b875-4916-b06a-9e57b68bd33a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:34.131428 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40303e-b875-4916-b06a-9e57b68bd33a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:34.132828 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1321] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:34.138248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a358-3a88-409f-899a-8303780d2266 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:34.138682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a358-3a88-409f-899a-8303780d2266 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:34.138819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034a358-3a88-409f-899a-8303780d2266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:34.205001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6034a358-3a88-409f-899a-8303780d2266 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:34.206224 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6034a358-3a88-409f-899a-8303780d2266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:34.270894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:34.315535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 670/1322] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:34.368602 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:34.368928 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:34.369210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:34.370709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1323] 10.222.0.10 () {54 vars in 964 bytes} [Fri Jun 10 12:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:34.377681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc947f-654e-4092-b4e5-a6e508f3fe27 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:34.378000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc947f-654e-4092-b4e5-a6e508f3fe27 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:34.378278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc947f-654e-4092-b4e5-a6e508f3fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:34.457850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3ddc947f-654e-4092-b4e5-a6e508f3fe27 None None] MFA Rules not processed for user `2fda4f42ba344b4f960ed39a006b887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:34.459051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3ddc947f-654e-4092-b4e5-a6e508f3fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:34.539680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 671/1324] 10.222.0.10 () {58 vars in 1061 bytes} [Fri Jun 10 12:56:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:34.549695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:34.551215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:34.570902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:34.659033 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93fb3-3d04-4527-9b27-34ae320c6183 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:34.732047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:34.732712 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:34.732994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:34.733264 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:34.734866 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:34.807285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:34.844944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:34.846386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad26da-8b41-4dbb-b35d-22e29f8681d0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:34.864559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1325] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:37.252240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:37.252791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:37.252885 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:37.254216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 672/1326] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:37.259343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b93d-fcd9-4984-8067-7c9abafa5780 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:37.259755 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b93d-fcd9-4984-8067-7c9abafa5780 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:37.260023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177b93d-fcd9-4984-8067-7c9abafa5780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:37.326202 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0177b93d-fcd9-4984-8067-7c9abafa5780 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:37.327397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0177b93d-fcd9-4984-8067-7c9abafa5780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:37.431495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1327] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:37.469413 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:37.471035 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:37.537712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:37.582149 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f5c5a-3a22-42d8-9389-fa07056ffb1a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:37.666597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:37.667134 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:37.667946 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:37.668277 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:37.669971 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:37.777997 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:37.780324 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:37.782121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80719025-82b0-4a4d-b229-d573c996e852 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:37.802050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 673/1328] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:39.994944 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:39.995517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:39.995517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:39.996961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1329] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:40.002785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526b01-6215-4147-904f-743038c39d71 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:40.003301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526b01-6215-4147-904f-743038c39d71 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:40.003401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae526b01-6215-4147-904f-743038c39d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:40.079591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ae526b01-6215-4147-904f-743038c39d71 None None] MFA Rules not processed for user `8faceef41f5540618c0b0bd5ebe3f908`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:40.080823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ae526b01-6215-4147-904f-743038c39d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:40.174080 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 674/1330] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:40.212173 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:40.213794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:40.246285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:40.320401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2065b0-4830-4601-aff3-f78b99dd8e53 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:40.395808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:40.396452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:40.396789 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:40.397066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:40.398693 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:40.475256 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:40.508744 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:40.510980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dba90-944c-45ba-83c0-f25516c9abe0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:40.531632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1331] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:43.116512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:43.117120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:43.117120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:43.118531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 675/1332] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:43.124245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039ec8-59d0-4c89-9118-cc2249a02476 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:43.124690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039ec8-59d0-4c89-9118-cc2249a02476 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:43.124837 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039ec8-59d0-4c89-9118-cc2249a02476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:43.189725 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ba039ec8-59d0-4c89-9118-cc2249a02476 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:43.191078 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba039ec8-59d0-4c89-9118-cc2249a02476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:43.286453 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1333] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:43.321923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:43.323451 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:43.393047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:43.427645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652213e-c424-450f-9c80-ee48075b8fcb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:43.500309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:43.501050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:43.501340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:43.501622 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:43.503314 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:43.611791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:43.613282 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d1948-0ab9-41f1-9bbf-101dd2a96d3c service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:43.623274 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:43.631609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 676/1334] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:45.793307 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:45.793861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:45.793861 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:45.795245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1335] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:45.800261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca2810-3c88-4c81-8f5c-6cdc0eedb566 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:45.800727 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca2810-3c88-4c81-8f5c-6cdc0eedb566 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:45.800834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca2810-3c88-4c81-8f5c-6cdc0eedb566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:45.864465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5cca2810-3c88-4c81-8f5c-6cdc0eedb566 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:45.865707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5cca2810-3c88-4c81-8f5c-6cdc0eedb566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:45.964482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 677/1336] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:46.004532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:46.006083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:46.045687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:46.106967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37e1d9-bea1-43ac-aef4-f2898edb1f52 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:46.178277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:46.178915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:46.179196 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:46.179470 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:46.181115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:46.261701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:46.287809 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:46.289267 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f374f-60ad-4973-9a6a-7feaf304a65a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:46.308984 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1337] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:49.105737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:49.106279 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:49.106376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:49.107695 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 678/1338] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:49.113024 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c3e9-4176-4ee7-a452-812e2cde4a90 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:49.113422 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c3e9-4176-4ee7-a452-812e2cde4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:49.113589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c3e9-4176-4ee7-a452-812e2cde4a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:49.178010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f8d7c3e9-4176-4ee7-a452-812e2cde4a90 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:49.179210 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f8d7c3e9-4176-4ee7-a452-812e2cde4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:49.273168 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1339] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:49.309491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:49.311000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:49.387465 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:49.414493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f7609-414e-416f-bbfe-b74bd05cc894 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:49.488554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:49.489261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:49.489574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:49.489850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:49.491496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:49.600931 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:49.602364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da1885-d5e2-4c15-90a5-322e440b7358 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:49.621979 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 679/1340] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:53.998826 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:53.999373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:53.999373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:54.004821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1341] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:54.006485 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039712-e619-44ff-b3cf-326e80777755 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:54.006919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039712-e619-44ff-b3cf-326e80777755 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:54.007102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24039712-e619-44ff-b3cf-326e80777755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:54.014636 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:54.083024 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-24039712-e619-44ff-b3cf-326e80777755 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:54.084268 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-24039712-e619-44ff-b3cf-326e80777755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:54.188389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 680/1342] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:56:54.226400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:54.228509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:54.279563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:56:54.326110 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c822d93-5a83-4a7f-b7c1-f8643de897f1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:54.329691 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:54.330333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:54.330616 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:54.330889 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:54.339926 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:54.341387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd2e54-f236-4619-abc7-7ce3d6129b40 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:54.350778 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1343] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:56:57.858624 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:57.859190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:57.859190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:57.860536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 681/1344] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:56:57.865962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bd00-b959-421d-b420-cbfcec3a12fb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:57.866363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bd00-b959-421d-b420-cbfcec3a12fb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:57.866526 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8bd00-b959-421d-b420-cbfcec3a12fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:57.894456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7cf8bd00-b959-421d-b420-cbfcec3a12fb None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:56:57.895636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7cf8bd00-b959-421d-b420-cbfcec3a12fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:57.971573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1345] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:56:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:56:58.009140 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:56:58.010973 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:56:58.023907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d81383-bd15-4961-aa38-b9b3e0261624 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:56:58.027457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:56:58.028092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:56:58.028377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:56:58.028681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:56:58.038264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:56:58.039819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed097b07-8f8e-4df0-9055-fee3692eb1a4 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:56:58.050144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 682/1346] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:56:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:02.401569 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160072-3f4b-4384-9c09-324570452eb2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:02.402104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160072-3f4b-4384-9c09-324570452eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:02.402104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f160072-3f4b-4384-9c09-324570452eb2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:02.403516 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1347] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:02.409096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c859-698e-4ab0-815b-accedefd4a34 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:02.409511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c859-698e-4ab0-815b-accedefd4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:02.409661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100c859-698e-4ab0-815b-accedefd4a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:02.428627 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9100c859-698e-4ab0-815b-accedefd4a34 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:02.429861 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9100c859-698e-4ab0-815b-accedefd4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:02.438513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 683/1348] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:02.476790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160072-3f4b-4384-9c09-324570452eb2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:02.487930 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f160072-3f4b-4384-9c09-324570452eb2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:02.491525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:02.492201 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:02.492485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:02.492797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:02.503111 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:02.504469 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a03ab-644a-43ba-b08e-f706acca839e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:02.515397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1349] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:07.555649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31fc02-c68f-4994-9391-e33e6416d947 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:07.556562 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31fc02-c68f-4994-9391-e33e6416d947 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:07.557655 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31fc02-c68f-4994-9391-e33e6416d947 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:07.559503 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 684/1350] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 12:57:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:07.564556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37a87-95d1-42ae-ae34-8596be5fa464 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:07.565051 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37a87-95d1-42ae-ae34-8596be5fa464 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:07.565142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd37a87-95d1-42ae-ae34-8596be5fa464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:07.647245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ecd37a87-95d1-42ae-ae34-8596be5fa464 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:07.648431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ecd37a87-95d1-42ae-ae34-8596be5fa464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:07.677522 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:07.730496 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1351] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 12:57:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:11.986286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563450-dda1-4a51-95eb-e5b1ccac269c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:11.987512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563450-dda1-4a51-95eb-e5b1ccac269c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:11.987901 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd563450-dda1-4a51-95eb-e5b1ccac269c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:11.989539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 685/1352] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 12:57:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:11.995474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84afe6-d51e-4450-a3ec-6674c45c7962 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:11.996331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84afe6-d51e-4450-a3ec-6674c45c7962 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:11.996868 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84afe6-d51e-4450-a3ec-6674c45c7962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:12.017694 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b84afe6-d51e-4450-a3ec-6674c45c7962 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:12.019540 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b84afe6-d51e-4450-a3ec-6674c45c7962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:12.029761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1353] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 12:57:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:12.423187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=72 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:13.469777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aeb7-c901-4277-b436-f2287a750609 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:13.470431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aeb7-c901-4277-b436-f2287a750609 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:13.470431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aeb7-c901-4277-b436-f2287a750609 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:13.471716 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 686/1354] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 12:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:13.476802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813dc9-cbb8-46dc-a414-2e4ea639a6b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:13.477243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813dc9-cbb8-46dc-a414-2e4ea639a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:13.477493 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813dc9-cbb8-46dc-a414-2e4ea639a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:13.496788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f4813dc9-cbb8-46dc-a414-2e4ea639a6b9 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:13.499996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4813dc9-cbb8-46dc-a414-2e4ea639a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:13.507092 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1355] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:57:17.396158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed71f-1518-4d0e-a9d2-2cc8ca574086 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:17.396158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed71f-1518-4d0e-a9d2-2cc8ca574086 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:17.396158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbed71f-1518-4d0e-a9d2-2cc8ca574086 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:17.396158 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 687/1356] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:17.399961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358de5-edc0-4a70-919c-40c4877c066f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:17.400413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358de5-edc0-4a70-919c-40c4877c066f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:17.400705 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05358de5-edc0-4a70-919c-40c4877c066f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:17.420036 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-05358de5-edc0-4a70-919c-40c4877c066f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:17.421403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-05358de5-edc0-4a70-919c-40c4877c066f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:17.429669 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1357] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:17.485796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8838-78c4-43a9-9da2-b96cfaa59851 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:17.486369 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8838-78c4-43a9-9da2-b96cfaa59851 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:17.486796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8838-78c4-43a9-9da2-b96cfaa59851 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:17.489004 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 688/1358] 10.222.0.10 () {54 vars in 961 bytes} [Fri Jun 10 12:57:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:17.497657 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ec56-aca4-413e-bef5-119df288200c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:17.498298 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ec56-aca4-413e-bef5-119df288200c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:17.500752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938ec56-aca4-413e-bef5-119df288200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:17.559788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b938ec56-aca4-413e-bef5-119df288200c None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:17.561011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b938ec56-aca4-413e-bef5-119df288200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:17.660529 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1359] 10.222.0.10 () {58 vars in 1058 bytes} [Fri Jun 10 12:57:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:17.669915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d8838-78c4-43a9-9da2-b96cfaa59851 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:17.684848 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d8838-78c4-43a9-9da2-b96cfaa59851 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:17.690368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:17.691117 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:17.691453 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:17.691735 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:17.703019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:17.705170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4a05b-1616-48ed-9068-ae2921c3cb00 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:17.725061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 689/1360] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 12:57:20.136636 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987d1e-86be-4468-a5e3-109ab29e40ac None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:20.137188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987d1e-86be-4468-a5e3-109ab29e40ac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:20.137188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f987d1e-86be-4468-a5e3-109ab29e40ac None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:20.138732 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1361] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:20.144530 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407263bb-a7cf-43e2-89c0-996f782d6707 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:20.145087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407263bb-a7cf-43e2-89c0-996f782d6707 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:20.145188 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407263bb-a7cf-43e2-89c0-996f782d6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:20.167129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-407263bb-a7cf-43e2-89c0-996f782d6707 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:20.168685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-407263bb-a7cf-43e2-89c0-996f782d6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:20.176570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 690/1362] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:20.223466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987d1e-86be-4468-a5e3-109ab29e40ac None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:20.238334 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f987d1e-86be-4468-a5e3-109ab29e40ac None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:20.244040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:20.244698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:20.244988 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:20.245268 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:20.254235 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:20.255807 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0e22-62f4-4e5b-ae19-c316d21b24b3 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:20.268263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1363] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:22.887037 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743b0c-c769-42da-aee9-2b0c4e0f9336 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:22.887599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743b0c-c769-42da-aee9-2b0c4e0f9336 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:22.887599 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743b0c-c769-42da-aee9-2b0c4e0f9336 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:22.889480 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 691/1364] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:22.894738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768508-01fb-4a23-bc36-5de768908136 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:22.895166 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768508-01fb-4a23-bc36-5de768908136 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:22.895372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768508-01fb-4a23-bc36-5de768908136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:22.914103 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6a768508-01fb-4a23-bc36-5de768908136 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:22.915292 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6a768508-01fb-4a23-bc36-5de768908136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:22.924375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1365] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:22.974953 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aea12-1b79-4257-93ae-41bce3ce02f3 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:22.975238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aea12-1b79-4257-93ae-41bce3ce02f3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:22.975513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8aea12-1b79-4257-93ae-41bce3ce02f3 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:22.976920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 692/1366] 10.222.0.10 () {54 vars in 961 bytes} [Fri Jun 10 12:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:22.983564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2d63-cde5-4d87-a4c4-ecf86ddc9692 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:22.983988 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2d63-cde5-4d87-a4c4-ecf86ddc9692 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:22.984555 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2d63-cde5-4d87-a4c4-ecf86ddc9692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:23.006968 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-909a2d63-cde5-4d87-a4c4-ecf86ddc9692 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:23.012902 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-909a2d63-cde5-4d87-a4c4-ecf86ddc9692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:23.020100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1367] 10.222.0.10 () {58 vars in 1058 bytes} [Fri Jun 10 12:57:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:23.038966 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aea12-1b79-4257-93ae-41bce3ce02f3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:23.059954 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8aea12-1b79-4257-93ae-41bce3ce02f3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:23.065482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:23.066118 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:23.066430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:23.066841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:23.076092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:23.078040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282067b-dd86-465d-8688-cf60b195617c service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:23.088287 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 693/1368] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:25.487752 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9898f-3bd9-40ff-8043-df43e18bcfd4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:25.488681 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9898f-3bd9-40ff-8043-df43e18bcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:25.489171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9898f-3bd9-40ff-8043-df43e18bcfd4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:25.490787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1369] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:25.496478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b0fd-1921-4522-b2b9-659fd6b1740c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:25.496986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b0fd-1921-4522-b2b9-659fd6b1740c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:25.497069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5b0fd-1921-4522-b2b9-659fd6b1740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:25.516544 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-77b5b0fd-1921-4522-b2b9-659fd6b1740c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:25.517756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77b5b0fd-1921-4522-b2b9-659fd6b1740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:25.526604 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 694/1370] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:25.569869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9898f-3bd9-40ff-8043-df43e18bcfd4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:25.584955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9898f-3bd9-40ff-8043-df43e18bcfd4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:25.591152 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:25.591788 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:25.592069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:25.592338 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:25.601106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:25.602702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b7204-24b5-4b0f-ae77-b6337e88a877 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:25.615195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1371] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:25.717691 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508f25e-a566-416d-864b-dc770dd60841 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:25.717985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508f25e-a566-416d-864b-dc770dd60841 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:25.718240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508f25e-a566-416d-864b-dc770dd60841 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:25.719621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 695/1372] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:25.725644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbe67-e477-4655-84c2-478138a918ad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:25.725936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbe67-e477-4655-84c2-478138a918ad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:25.726215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bbe67-e477-4655-84c2-478138a918ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:25.752527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a70bbe67-e477-4655-84c2-478138a918ad None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:25.753924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a70bbe67-e477-4655-84c2-478138a918ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:25.763047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1373] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:26.068299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e8da-f109-449b-81a9-294a1a4358c0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:26.068680 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e8da-f109-449b-81a9-294a1a4358c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:26.069031 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e8da-f109-449b-81a9-294a1a4358c0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:26.070619 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 696/1374] 10.222.0.10 () {54 vars in 963 bytes} [Fri Jun 10 12:57:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:26.076212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46fd4-8b1c-4550-a0f9-22713bb4c4f3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:26.076585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46fd4-8b1c-4550-a0f9-22713bb4c4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:26.076951 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46fd4-8b1c-4550-a0f9-22713bb4c4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:26.083459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:26.128965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f4c46fd4-8b1c-4550-a0f9-22713bb4c4f3 None None] MFA Rules not processed for user `d39acd104e2b41119ce9454dbb4428ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:26.130510 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4c46fd4-8b1c-4550-a0f9-22713bb4c4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:26.196135 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1375] 10.222.0.10 () {58 vars in 1060 bytes} [Fri Jun 10 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:26.203877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e8da-f109-449b-81a9-294a1a4358c0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:26.214679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e8da-f109-449b-81a9-294a1a4358c0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:26.218308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd39acd104e2b41119ce9454dbb4428ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:26.218937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:26.219431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:26.219711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:26.230066 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:26.231505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d3868-b82e-4724-b501-b5f53502687b service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:26.241398 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 697/1376] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:27.970415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12406f-2cda-4b6f-a8db-75c520e139c8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:27.970950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12406f-2cda-4b6f-a8db-75c520e139c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:27.970950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12406f-2cda-4b6f-a8db-75c520e139c8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:27.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1377] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:27.977912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8d5d-1fc6-4611-ba47-53efb27db0fa None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:27.979045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8d5d-1fc6-4611-ba47-53efb27db0fa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:27.979216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8d5d-1fc6-4611-ba47-53efb27db0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:27.997675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b05e8d5d-1fc6-4611-ba47-53efb27db0fa None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:27.998899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b05e8d5d-1fc6-4611-ba47-53efb27db0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:28.006800 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 698/1378] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:28.053710 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12406f-2cda-4b6f-a8db-75c520e139c8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:28.068476 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12406f-2cda-4b6f-a8db-75c520e139c8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:28.075397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:28.076046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:28.076331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:28.076607 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:28.085695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:28.087336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470928a-1b0c-447c-9ca6-1ca5f32146c3 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:28.097617 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1379] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:30.481531 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5af43-16d6-4f7d-b372-33076dae91de None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:30.482091 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5af43-16d6-4f7d-b372-33076dae91de None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:30.482261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5af43-16d6-4f7d-b372-33076dae91de None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:30.484418 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 699/1380] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:30.489091 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817550cb-8a56-47c2-b9c5-8dc142d1c1a0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:30.489509 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817550cb-8a56-47c2-b9c5-8dc142d1c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:30.489640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817550cb-8a56-47c2-b9c5-8dc142d1c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:30.508069 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-817550cb-8a56-47c2-b9c5-8dc142d1c1a0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:30.509335 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-817550cb-8a56-47c2-b9c5-8dc142d1c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:30.517403 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1381] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:30.562339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5af43-16d6-4f7d-b372-33076dae91de None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:30.577692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5af43-16d6-4f7d-b372-33076dae91de None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:30.583174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:30.583915 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:30.584335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:30.584747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:30.593470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:30.595168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2d9e0-fc72-4a95-b11c-a52249a1521d service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:30.605839 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 700/1382] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:32.936059 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36630b-5922-4018-981b-bbf0ab409399 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:32.936656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36630b-5922-4018-981b-bbf0ab409399 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:32.937500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36630b-5922-4018-981b-bbf0ab409399 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:32.939195 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1383] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:32.945185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721aed-22dd-493b-8ad9-303ce7288b1f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:32.945729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721aed-22dd-493b-8ad9-303ce7288b1f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:32.945729 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca721aed-22dd-493b-8ad9-303ce7288b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:32.966694 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ca721aed-22dd-493b-8ad9-303ce7288b1f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:32.967993 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ca721aed-22dd-493b-8ad9-303ce7288b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:32.976188 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 701/1384] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:33.020050 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36630b-5922-4018-981b-bbf0ab409399 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:33.035869 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36630b-5922-4018-981b-bbf0ab409399 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:33.042851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:33.043512 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:33.043793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:33.044065 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:33.053503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:33.055089 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5826f-b2b5-4c8b-ad2c-9eeafce9b8d3 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:33.066096 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1385] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:35.216633 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9efa-4ba2-42fd-8cce-2dac05d67a65 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:35.217316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9efa-4ba2-42fd-8cce-2dac05d67a65 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:35.217316 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf9efa-4ba2-42fd-8cce-2dac05d67a65 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:35.218580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 702/1386] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:35.223882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9b41-fb89-40cd-90d7-fc025f02b547 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:35.224452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9b41-fb89-40cd-90d7-fc025f02b547 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:35.224544 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9b41-fb89-40cd-90d7-fc025f02b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:35.243401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c94e9b41-fb89-40cd-90d7-fc025f02b547 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:35.244757 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c94e9b41-fb89-40cd-90d7-fc025f02b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:35.252640 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1387] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:35.300256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9efa-4ba2-42fd-8cce-2dac05d67a65 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:35.315238 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf9efa-4ba2-42fd-8cce-2dac05d67a65 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:35.320905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:35.322087 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:35.322390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:35.322682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:35.331431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:35.333096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8f434-5ff6-4409-abb2-f75416b6c38a service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:35.344506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 703/1388] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:37.750276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd77c-25d2-4e19-ba61-db5a58e1085d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:37.750843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd77c-25d2-4e19-ba61-db5a58e1085d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:37.750843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfd77c-25d2-4e19-ba61-db5a58e1085d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:37.752245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1389] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:37.757725 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a6ce-2d8d-4070-8e4d-a8848fa20f7e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:37.758171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a6ce-2d8d-4070-8e4d-a8848fa20f7e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:37.758298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a6ce-2d8d-4070-8e4d-a8848fa20f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:37.778613 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f8b6a6ce-2d8d-4070-8e4d-a8848fa20f7e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:37.779890 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f8b6a6ce-2d8d-4070-8e4d-a8848fa20f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:37.788646 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 704/1390] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:37.837563 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd77c-25d2-4e19-ba61-db5a58e1085d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:37.856248 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfd77c-25d2-4e19-ba61-db5a58e1085d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:37.863156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:37.864207 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:37.864474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:37.864874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:37.875897 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:37.877852 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aa26c-f0b6-4f21-9e6b-3a617dd3dfb0 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:37.890018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1391] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:40.175032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2e14-2bd7-42cc-a3e5-2c0331590839 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:40.175632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2e14-2bd7-42cc-a3e5-2c0331590839 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:40.175632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c2e14-2bd7-42cc-a3e5-2c0331590839 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:40.176985 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 705/1392] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:40.182947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054190-fe63-4be4-bb7a-9114bdda457d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:40.183363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054190-fe63-4be4-bb7a-9114bdda457d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:40.183634 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054190-fe63-4be4-bb7a-9114bdda457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:40.201942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c0054190-fe63-4be4-bb7a-9114bdda457d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:40.203141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c0054190-fe63-4be4-bb7a-9114bdda457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:40.211127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1393] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:57:40.254635 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2e14-2bd7-42cc-a3e5-2c0331590839 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:40.269634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c2e14-2bd7-42cc-a3e5-2c0331590839 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:40.274923 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:40.275555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:40.275833 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:40.276104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:40.284758 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:40.286320 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a328b4c-aadf-4e18-81bf-01fea1efc845 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:40.296026 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 706/1394] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:41.909362 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742391-d394-45f6-bc91-4c80d4ab33b9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:41.909892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742391-d394-45f6-bc91-4c80d4ab33b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:41.909892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54742391-d394-45f6-bc91-4c80d4ab33b9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:41.911272 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1395] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:41.917303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1270e-d3d1-461f-b007-01eca1e55ad3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:41.917745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1270e-d3d1-461f-b007-01eca1e55ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:41.917852 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1270e-d3d1-461f-b007-01eca1e55ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:41.936045 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4da1270e-d3d1-461f-b007-01eca1e55ad3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:41.937388 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4da1270e-d3d1-461f-b007-01eca1e55ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:41.945717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 707/1396] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:57:42.004388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fcc1-5406-4b6a-a874-1ad6863b889b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.004714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fcc1-5406-4b6a-a874-1ad6863b889b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.005001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87fcc1-5406-4b6a-a874-1ad6863b889b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.006372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1397] 10.222.0.10 () {54 vars in 962 bytes} [Fri Jun 10 12:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:42.011488 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9c76-9861-4853-a630-df50e0930128 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.011783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9c76-9861-4853-a630-df50e0930128 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.012071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b9c76-9861-4853-a630-df50e0930128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.061914 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-373b9c76-9861-4853-a630-df50e0930128 None None] MFA Rules not processed for user `1c6c076588d9458784247cdfec12c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:42.063131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-373b9c76-9861-4853-a630-df50e0930128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:42.121313 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 708/1398] 10.222.0.10 () {58 vars in 1059 bytes} [Fri Jun 10 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:42.128954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87fcc1-5406-4b6a-a874-1ad6863b889b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:42.139377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87fcc1-5406-4b6a-a874-1ad6863b889b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:42.142780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6c076588d9458784247cdfec12c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:42.143405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.143682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.143950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.152816 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:42.154226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd474a-5da8-4ca8-bd25-45a426d5a8ad service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:42.163802 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1399] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:42.580649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e43e3-0dbd-461f-be04-59afaa02292d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.580958 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e43e3-0dbd-461f-be04-59afaa02292d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.581249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e43e3-0dbd-461f-be04-59afaa02292d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.582632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 709/1400] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:42.588922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895299-f1e6-4e57-967b-a87b0807fcfe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.589212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895299-f1e6-4e57-967b-a87b0807fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.589528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e895299-f1e6-4e57-967b-a87b0807fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.608406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5e895299-f1e6-4e57-967b-a87b0807fcfe None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:42.611424 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5e895299-f1e6-4e57-967b-a87b0807fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:42.620670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1401] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:42.664460 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e43e3-0dbd-461f-be04-59afaa02292d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:42.672905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:42.679590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e43e3-0dbd-461f-be04-59afaa02292d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:42.685749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:42.688079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:42.688079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:42.688079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:42.698693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:42.700583 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431443e-02ff-42e3-940c-aae044835575 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:42.712019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 710/1402] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:43.044548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253ef5-8263-4a93-b6a9-dcf42cbc2efa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:43.045066 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253ef5-8263-4a93-b6a9-dcf42cbc2efa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:43.045174 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253ef5-8263-4a93-b6a9-dcf42cbc2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:43.095232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b3253ef5-8263-4a93-b6a9-dcf42cbc2efa None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:43.096427 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3253ef5-8263-4a93-b6a9-dcf42cbc2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:43.130363 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:43.162643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1403] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:43.209863 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6b39-d32e-4f40-a79e-0e976e72cd76 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:43.210350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6b39-d32e-4f40-a79e-0e976e72cd76 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:43.210693 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf6b39-d32e-4f40-a79e-0e976e72cd76 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:43.212753 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 711/1404] 10.222.0.10 () {54 vars in 942 bytes} [Fri Jun 10 12:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:43.219845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399427b-5295-4e9b-a463-1d2b64011d78 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:43.220170 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399427b-5295-4e9b-a463-1d2b64011d78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:43.220463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399427b-5295-4e9b-a463-1d2b64011d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:43.270144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f399427b-5295-4e9b-a463-1d2b64011d78 None None] MFA Rules not processed for user `0042ad86624e4eb08844d9112381820e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:43.271362 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f399427b-5295-4e9b-a463-1d2b64011d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:43.349133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1405] 10.222.0.10 () {58 vars in 1039 bytes} [Fri Jun 10 12:57:43 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:43.358773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6b39-d32e-4f40-a79e-0e976e72cd76 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:43.373219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf6b39-d32e-4f40-a79e-0e976e72cd76 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:43.378395 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:43.379051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:43.379344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:43.379621 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:43.388935 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:43.390505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6ad5d-13d3-4329-8bc9-b11c9272dfa6 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:43.399123 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 712/1406] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 12:57:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 12:57:45.012032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1211-f93f-4508-8450-72e2420f294e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:45.012686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1211-f93f-4508-8450-72e2420f294e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:45.012686 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e1211-f93f-4508-8450-72e2420f294e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:45.013924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1407] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:57:45.019206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cb5d-95ae-40ea-acd1-fbad1586509b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:45.019690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cb5d-95ae-40ea-acd1-fbad1586509b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:45.019796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cb5d-95ae-40ea-acd1-fbad1586509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:45.043554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9559cb5d-95ae-40ea-acd1-fbad1586509b None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:57:45.045125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9559cb5d-95ae-40ea-acd1-fbad1586509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:57:45.056671 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 713/1408] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:57:45.100188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1211-f93f-4508-8450-72e2420f294e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:57:45.118023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e1211-f93f-4508-8450-72e2420f294e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:57:45.124479 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:57:45.125182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:57:45.125459 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:57:45.125737 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:57:45.135426 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:57:45.137392 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ec3a9-a064-4b23-bc7c-9db73fc75992 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:57:45.148405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1409] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:57:55.033587 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=14 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:57:55.143780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=62 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:58:06.698477 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cac5-4a51-46a9-861b-52c2613dee77 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:06.699038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cac5-4a51-46a9-861b-52c2613dee77 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:06.699038 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994cac5-4a51-46a9-861b-52c2613dee77 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:06.700436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 714/1410] 10.222.0.10 () {54 vars in 918 bytes} [Fri Jun 10 12:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:06.705359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321371db-f460-45c8-b875-96f0b7d06a83 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:06.705754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321371db-f460-45c8-b875-96f0b7d06a83 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:06.705940 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321371db-f460-45c8-b875-96f0b7d06a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:06.723456 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-321371db-f460-45c8-b875-96f0b7d06a83 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:06.724670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-321371db-f460-45c8-b875-96f0b7d06a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:06.733599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1411] 10.222.0.10 () {58 vars in 1015 bytes} [Fri Jun 10 12:58:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:06.748210 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9b62e-2a66-4765-9aa6-c9fd7a252b4e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:06.748497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9b62e-2a66-4765-9aa6-c9fd7a252b4e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:06.748826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9b62e-2a66-4765-9aa6-c9fd7a252b4e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:06.750155 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 715/1412] 10.222.0.10 () {54 vars in 918 bytes} [Fri Jun 10 12:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:06.754683 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd272b0-f357-40fa-bd4e-0619f077ca80 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:06.754971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd272b0-f357-40fa-bd4e-0619f077ca80 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:06.755250 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd272b0-f357-40fa-bd4e-0619f077ca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:06.773443 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8dd272b0-f357-40fa-bd4e-0619f077ca80 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:06.774746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8dd272b0-f357-40fa-bd4e-0619f077ca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:06.783981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1413] 10.222.0.10 () {58 vars in 1015 bytes} [Fri Jun 10 12:58:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:09.379688 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff9a7-4d9f-4234-8c55-7320e0d8e1ab None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:09.380231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff9a7-4d9f-4234-8c55-7320e0d8e1ab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:09.380231 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff9a7-4d9f-4234-8c55-7320e0d8e1ab None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:09.381656 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:09.386801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079a58-4e54-4719-ada3-671fcd3b7146 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:09.387240 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079a58-4e54-4719-ada3-671fcd3b7146 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:09.387347 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab079a58-4e54-4719-ada3-671fcd3b7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:09.405366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ab079a58-4e54-4719-ada3-671fcd3b7146 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:09.406818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab079a58-4e54-4719-ada3-671fcd3b7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:09.415604 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:09.459233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dff9a7-4d9f-4234-8c55-7320e0d8e1ab None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:09.473850 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dff9a7-4d9f-4234-8c55-7320e0d8e1ab None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:09.480128 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:09.480785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:09.481064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:09.481334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:09.489365 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:09.490999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786b974-95ce-4684-8975-b093e4d25eca service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:09.500245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 717/1416] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:10.448857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d0f1-5209-4bdd-ad34-d0edd93b2737 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:10.449399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d0f1-5209-4bdd-ad34-d0edd93b2737 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:10.449399 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131d0f1-5209-4bdd-ad34-d0edd93b2737 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:10.450793 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:10.455640 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324018ff-fbeb-4366-aa82-7b1d4ae3f554 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:10.456067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324018ff-fbeb-4366-aa82-7b1d4ae3f554 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:10.456195 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324018ff-fbeb-4366-aa82-7b1d4ae3f554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:10.473498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-324018ff-fbeb-4366-aa82-7b1d4ae3f554 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:10.474679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-324018ff-fbeb-4366-aa82-7b1d4ae3f554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:10.482899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:10.633698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d0f1-5209-4bdd-ad34-d0edd93b2737 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:10.648081 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131d0f1-5209-4bdd-ad34-d0edd93b2737 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:10.653787 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:10.654420 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:10.654706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:10.654983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:10.663396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:10.665884 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25f712-2cfd-4564-ac25-53d8f9e46028 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:10.675132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1419] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:11.599251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ab7f-a53e-492e-83ba-480f983abf39 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:11.599842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ab7f-a53e-492e-83ba-480f983abf39 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:11.599842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975ab7f-a53e-492e-83ba-480f983abf39 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:11.601248 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:11.606395 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524995-2812-41e6-b5f2-6e2576d7e560 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:11.606801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524995-2812-41e6-b5f2-6e2576d7e560 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:11.606953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524995-2812-41e6-b5f2-6e2576d7e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:11.625098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-03524995-2812-41e6-b5f2-6e2576d7e560 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:11.626277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03524995-2812-41e6-b5f2-6e2576d7e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:11.634559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:11.787773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ab7f-a53e-492e-83ba-480f983abf39 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:11.802306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975ab7f-a53e-492e-83ba-480f983abf39 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:11.808526 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:11.809187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:11.809474 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:11.809750 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:11.817854 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:11.819558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed2d8a-076e-4f7f-ae58-2d69ca76061b service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:11.830169 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 720/1422] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:12.749190 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7241252-6eb3-474c-9383-92e9fec81262 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:12.749751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7241252-6eb3-474c-9383-92e9fec81262 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:12.749751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7241252-6eb3-474c-9383-92e9fec81262 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:12.751155 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:12.756014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141f3d-35cd-418e-a2d2-f4a72317d918 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:12.756427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141f3d-35cd-418e-a2d2-f4a72317d918 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:12.756559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141f3d-35cd-418e-a2d2-f4a72317d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:12.774434 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-87141f3d-35cd-418e-a2d2-f4a72317d918 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:12.775629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-87141f3d-35cd-418e-a2d2-f4a72317d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:12.783595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:58:12.934605 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7241252-6eb3-474c-9383-92e9fec81262 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:12.949031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7241252-6eb3-474c-9383-92e9fec81262 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:12.954373 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:12.955008 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:12.955294 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:12.955573 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:12.964262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:12.965879 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fea71-b952-4d14-a496-79eedc59546b service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:12.975123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1425] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:13.889591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760201-8e32-46f0-9fa5-f56be65e3378 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:13.890133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760201-8e32-46f0-9fa5-f56be65e3378 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:13.890133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12760201-8e32-46f0-9fa5-f56be65e3378 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:13.891512 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:13.896447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce9d-0684-401a-b740-9fa8f6b3427a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:13.896937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce9d-0684-401a-b740-9fa8f6b3427a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:13.897040 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ce9d-0684-401a-b740-9fa8f6b3427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:13.916432 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69d7ce9d-0684-401a-b740-9fa8f6b3427a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:13.917661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69d7ce9d-0684-401a-b740-9fa8f6b3427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:13.925328 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:14.076340 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12760201-8e32-46f0-9fa5-f56be65e3378 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:14.091778 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12760201-8e32-46f0-9fa5-f56be65e3378 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:14.097106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:14.097734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:14.098020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:14.098298 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:14.106574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:14.108135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288f3f6-7ee2-40fd-bec4-3eb1071184d4 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:14.117384 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 723/1428] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:15.097937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5aa4e-ca52-4645-945c-1a8d9c487e62 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:15.098508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5aa4e-ca52-4645-945c-1a8d9c487e62 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:15.098508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5aa4e-ca52-4645-945c-1a8d9c487e62 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:15.099878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:15.105410 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf76b-3f93-4cb4-b977-910f1c443f31 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:15.105818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf76b-3f93-4cb4-b977-910f1c443f31 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:15.105974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf76b-3f93-4cb4-b977-910f1c443f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:15.124312 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-39dcf76b-3f93-4cb4-b977-910f1c443f31 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:15.125543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-39dcf76b-3f93-4cb4-b977-910f1c443f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:15.133554 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:15.284507 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5aa4e-ca52-4645-945c-1a8d9c487e62 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:15.299109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5aa4e-ca52-4645-945c-1a8d9c487e62 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:15.304286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:15.304965 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:15.305244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:15.305515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:15.313409 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:15.314970 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a8459-9dcd-4e6f-b207-704e8fa73331 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:15.324150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1431] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:16.255074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81709-f7cb-47b9-b6bd-c1b24a114f5d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:16.255666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81709-f7cb-47b9-b6bd-c1b24a114f5d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:16.255666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db81709-f7cb-47b9-b6bd-c1b24a114f5d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:16.257051 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:16.262980 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabff67-797a-4c7a-9ace-8058eb4bec55 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:16.263490 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabff67-797a-4c7a-9ace-8058eb4bec55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:16.263601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabff67-797a-4c7a-9ace-8058eb4bec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:16.285717 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7eabff67-797a-4c7a-9ace-8058eb4bec55 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:16.286996 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7eabff67-797a-4c7a-9ace-8058eb4bec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:16.295824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:16.449921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81709-f7cb-47b9-b6bd-c1b24a114f5d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:16.465170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db81709-f7cb-47b9-b6bd-c1b24a114f5d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:16.470490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:16.471120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:16.471406 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:16.471675 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:16.479983 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:16.481658 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a751d46-d3de-40bd-9d45-122aae8c8440 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:16.491071 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 726/1434] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:17.416601 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96883-0e93-458c-a844-16811d580338 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:17.417157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96883-0e93-458c-a844-16811d580338 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:17.417157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb96883-0e93-458c-a844-16811d580338 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:17.418486 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:17.423367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d715b-5743-49fd-aa45-55036a288b59 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:17.423822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d715b-5743-49fd-aa45-55036a288b59 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:17.423921 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d715b-5743-49fd-aa45-55036a288b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:17.442085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5d9d715b-5743-49fd-aa45-55036a288b59 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:17.443280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5d9d715b-5743-49fd-aa45-55036a288b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:17.451060 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:58:17.603478 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96883-0e93-458c-a844-16811d580338 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:17.618521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb96883-0e93-458c-a844-16811d580338 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:17.624079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:17.624754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:17.625036 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:17.625308 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:17.634142 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:17.635781 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a8ecd-ed29-447b-9c19-a06a87f34815 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:17.645108 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1437] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:18.553532 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb42b-c1c5-4060-b2f9-e1a495678506 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:18.554107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb42b-c1c5-4060-b2f9-e1a495678506 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:18.554107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb42b-c1c5-4060-b2f9-e1a495678506 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:18.555853 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 12:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:18.560592 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6d29-4b58-406f-b13e-a5b10a6ed0cb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:18.561016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6d29-4b58-406f-b13e-a5b10a6ed0cb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:18.561188 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6d29-4b58-406f-b13e-a5b10a6ed0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:18.579714 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-056f6d29-4b58-406f-b13e-a5b10a6ed0cb None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:18.580938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-056f6d29-4b58-406f-b13e-a5b10a6ed0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:18.589651 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:18.744856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb42b-c1c5-4060-b2f9-e1a495678506 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:18.759317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb42b-c1c5-4060-b2f9-e1a495678506 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:18.764593 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:18.765245 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:18.765525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:18.765798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:18.774428 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:18.776011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811715bb-e01b-4c62-a350-2ea91abe540b service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:18.785632 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 729/1440] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:20.788422 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fe9-70f3-4990-bd78-81979431f48f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:20.789584 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fe9-70f3-4990-bd78-81979431f48f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:20.789759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d208fe9-70f3-4990-bd78-81979431f48f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:20.791186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:20.796445 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e685b-2c14-48af-ae1a-054c77fea642 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:20.796895 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e685b-2c14-48af-ae1a-054c77fea642 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:20.797011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e685b-2c14-48af-ae1a-054c77fea642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:20.814120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1b4e685b-2c14-48af-ae1a-054c77fea642 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:20.815261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1b4e685b-2c14-48af-ae1a-054c77fea642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:20.823429 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:20.861814 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208fe9-70f3-4990-bd78-81979431f48f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:20.872381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d208fe9-70f3-4990-bd78-81979431f48f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:20.875805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:20.876422 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:20.876736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:20.877011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:20.886212 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:20.887626 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2857e9d-dcd3-481f-9a53-a0055a6cf813 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:20.896673 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1443] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:23.169239 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88fba-3af5-4967-86c5-443b5a905323 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:23.169810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88fba-3af5-4967-86c5-443b5a905323 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:23.169810 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c88fba-3af5-4967-86c5-443b5a905323 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:23.171226 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:23.176608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4b88-bf6b-4cec-b4f0-cb0ad311bfc4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:23.177011 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4b88-bf6b-4cec-b4f0-cb0ad311bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:23.177127 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f4b88-bf6b-4cec-b4f0-cb0ad311bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:23.194858 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b86f4b88-bf6b-4cec-b4f0-cb0ad311bfc4 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:23.196230 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b86f4b88-bf6b-4cec-b4f0-cb0ad311bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:23.203956 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:23.242062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88fba-3af5-4967-86c5-443b5a905323 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:23.252580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c88fba-3af5-4967-86c5-443b5a905323 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:23.256042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:23.256697 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:23.256984 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:23.257261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:23.266573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:23.268019 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0de6-e05e-4a00-becf-746f755903c0 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:23.278069 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 732/1446] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:25.778215 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50736ca-3ebe-45e0-afe8-1bd650c4165b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:25.778824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50736ca-3ebe-45e0-afe8-1bd650c4165b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:25.778824 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50736ca-3ebe-45e0-afe8-1bd650c4165b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:25.780115 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:25.785609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f3fa-f9db-4c44-b687-87bca20c4314 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:25.786054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f3fa-f9db-4c44-b687-87bca20c4314 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:25.786174 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1f3fa-f9db-4c44-b687-87bca20c4314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:25.804115 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-29d1f3fa-f9db-4c44-b687-87bca20c4314 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:25.805576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29d1f3fa-f9db-4c44-b687-87bca20c4314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:25.813299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:25.851093 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50736ca-3ebe-45e0-afe8-1bd650c4165b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:25.862425 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50736ca-3ebe-45e0-afe8-1bd650c4165b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:25.865958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:25.866585 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:25.866961 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:25.867163 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:25.875881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:25.877356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c41aa8-513e-438a-9beb-4ebfa8188888 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:25.886721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1449] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:28.138779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571109-09f7-4737-b1e7-71ba5f36fc24 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:28.139346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571109-09f7-4737-b1e7-71ba5f36fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:28.139346 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571109-09f7-4737-b1e7-71ba5f36fc24 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:28.140741 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:28.146112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6418-47a0-48d9-81b3-3487f42d6691 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:28.146541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6418-47a0-48d9-81b3-3487f42d6691 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:28.146645 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c6418-47a0-48d9-81b3-3487f42d6691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:28.167221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-744c6418-47a0-48d9-81b3-3487f42d6691 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:28.168421 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-744c6418-47a0-48d9-81b3-3487f42d6691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:28.176144 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:58:28.215172 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571109-09f7-4737-b1e7-71ba5f36fc24 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:28.225634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571109-09f7-4737-b1e7-71ba5f36fc24 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:28.229106 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:28.229730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:28.230012 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:28.230294 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:28.238998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:28.240423 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b454b6-aaee-49c0-89bc-2a537be01109 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:28.252103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 735/1452] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:30.533265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31a27-5f76-4e53-a391-5f1e34e3fbe8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:30.533830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31a27-5f76-4e53-a391-5f1e34e3fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:30.533830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f31a27-5f76-4e53-a391-5f1e34e3fbe8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:30.535237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:30.541386 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2c716-b88a-47fd-a1a9-111d37f3576e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:30.541844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2c716-b88a-47fd-a1a9-111d37f3576e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:30.541954 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2c716-b88a-47fd-a1a9-111d37f3576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:30.559199 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-09a2c716-b88a-47fd-a1a9-111d37f3576e None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:30.560383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-09a2c716-b88a-47fd-a1a9-111d37f3576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:30.568389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:30.607232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f31a27-5f76-4e53-a391-5f1e34e3fbe8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:30.618052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f31a27-5f76-4e53-a391-5f1e34e3fbe8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:30.621559 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:30.622191 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:30.622474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:30.622751 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:30.631705 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:30.633830 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79a3d1-9f45-4b83-aace-e72fb039ad09 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:30.643325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1455] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:32.864376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf820-b2bc-44f9-a936-c1b14c07aef5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:32.864984 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf820-b2bc-44f9-a936-c1b14c07aef5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:32.864984 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bf820-b2bc-44f9-a936-c1b14c07aef5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:32.866259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:32.872477 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caa38-9f42-42ba-968c-8e13213e145c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:32.872946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caa38-9f42-42ba-968c-8e13213e145c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:32.873068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6caa38-9f42-42ba-968c-8e13213e145c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:32.890643 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea6caa38-9f42-42ba-968c-8e13213e145c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:32.891832 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea6caa38-9f42-42ba-968c-8e13213e145c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:32.899608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:32.938097 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bf820-b2bc-44f9-a936-c1b14c07aef5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:32.948681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bf820-b2bc-44f9-a936-c1b14c07aef5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:32.952133 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:32.952787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:32.953074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:32.953349 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:32.962100 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:32.963518 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28aefa-846a-429a-8959-1d2e23d28e65 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:32.972645 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 738/1458] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:35.122316 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566963ce-55d2-4f47-8554-e05d22ffdc6e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:35.122887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566963ce-55d2-4f47-8554-e05d22ffdc6e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:35.122887 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566963ce-55d2-4f47-8554-e05d22ffdc6e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:35.124241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:35.129529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5cc6-2906-41a2-bd76-de32e8ca6237 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:35.130001 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5cc6-2906-41a2-bd76-de32e8ca6237 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:35.130110 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5cc6-2906-41a2-bd76-de32e8ca6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:35.136400 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=70 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:58:35.149168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-641b5cc6-2906-41a2-bd76-de32e8ca6237 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:35.150367 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-641b5cc6-2906-41a2-bd76-de32e8ca6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:35.158475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:35.196505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566963ce-55d2-4f47-8554-e05d22ffdc6e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:35.201837 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=73 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:58:35.207503 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566963ce-55d2-4f47-8554-e05d22ffdc6e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:35.211439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:35.213571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:35.213571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:35.213571 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:35.221964 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:35.223417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f63b3-edee-4c22-9379-a1cccd90237b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:35.233729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1461] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:37.396991 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13002b2-77f0-4aa7-ae84-9e470e17de44 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:37.397537 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13002b2-77f0-4aa7-ae84-9e470e17de44 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:37.397537 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13002b2-77f0-4aa7-ae84-9e470e17de44 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:37.399649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:37.404962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d5fd-5dcd-4725-8b7d-248e375d2376 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:37.405603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d5fd-5dcd-4725-8b7d-248e375d2376 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:37.413278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d5fd-5dcd-4725-8b7d-248e375d2376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:37.423282 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c264d5fd-5dcd-4725-8b7d-248e375d2376 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:37.424471 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c264d5fd-5dcd-4725-8b7d-248e375d2376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:37.432414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:37.469555 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13002b2-77f0-4aa7-ae84-9e470e17de44 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:37.480259 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13002b2-77f0-4aa7-ae84-9e470e17de44 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:37.483796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:37.484422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:37.484742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:37.485020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:37.493887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:37.495303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad184f-a2fe-4a89-a309-11a86334329f service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:37.504497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 741/1464] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:39.644500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb36ec5-7898-446e-a02e-763dbdb216ce None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:39.645019 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb36ec5-7898-446e-a02e-763dbdb216ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:39.645114 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb36ec5-7898-446e-a02e-763dbdb216ce None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:39.646447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:39.652425 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bc03-edb8-4e28-a2da-d61f565434f3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:39.652881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bc03-edb8-4e28-a2da-d61f565434f3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:39.653016 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91bc03-edb8-4e28-a2da-d61f565434f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:39.670536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6a91bc03-edb8-4e28-a2da-d61f565434f3 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:39.671747 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6a91bc03-edb8-4e28-a2da-d61f565434f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:39.679457 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:39.716699 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb36ec5-7898-446e-a02e-763dbdb216ce None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:39.727356 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb36ec5-7898-446e-a02e-763dbdb216ce None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:39.730840 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:39.731466 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:39.731747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:39.732022 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:39.740736 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:39.742159 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800be77-452f-424a-99ca-1e575017b5ec service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:39.751269 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1467] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:41.888511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ef45-be26-4b59-8adf-a4a81535bf23 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:41.889048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ef45-be26-4b59-8adf-a4a81535bf23 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:41.889048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63ef45-be26-4b59-8adf-a4a81535bf23 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:41.890385 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 12:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:58:41.895481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd584c-40c9-4f06-9ff8-c0ac0e106eac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:41.895898 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd584c-40c9-4f06-9ff8-c0ac0e106eac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:41.896046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd584c-40c9-4f06-9ff8-c0ac0e106eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:41.914197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7dbd584c-40c9-4f06-9ff8-c0ac0e106eac None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:58:41.915381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7dbd584c-40c9-4f06-9ff8-c0ac0e106eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:58:41.923042 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 12:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:58:41.959286 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63ef45-be26-4b59-8adf-a4a81535bf23 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:58:41.969804 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63ef45-be26-4b59-8adf-a4a81535bf23 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:58:41.973422 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:58:41.974054 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:58:41.974337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:58:41.974612 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:58:41.984122 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:58:41.985566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9ed55-9dd3-48c9-942a-33f700eedb32 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:58:41.995498 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 744/1470] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:58:51.909260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=17 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:58:51.990638 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=17 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:59:01.947901 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8719b-39f6-4c06-a5b8-2624597697af None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:01.948413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8719b-39f6-4c06-a5b8-2624597697af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:01.948413 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8719b-39f6-4c06-a5b8-2624597697af None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:01.949772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1471] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:01.954832 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe25c92-118d-420c-b62e-4158e8bd247c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:01.955264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe25c92-118d-420c-b62e-4158e8bd247c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:01.955394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe25c92-118d-420c-b62e-4158e8bd247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:01.974933 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ebe25c92-118d-420c-b62e-4158e8bd247c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:01.976952 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ebe25c92-118d-420c-b62e-4158e8bd247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:01.984595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 745/1472] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:59:02.031408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a935e-96db-4a7f-99a0-a442ce005614 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:02.031701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a935e-96db-4a7f-99a0-a442ce005614 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:02.032005 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a935e-96db-4a7f-99a0-a442ce005614 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:02.033393 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1473] 10.222.0.10 () {54 vars in 962 bytes} [Fri Jun 10 12:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:02.038678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2825b1-aa6d-4c11-98ca-c4c061636fbd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:02.038964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2825b1-aa6d-4c11-98ca-c4c061636fbd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:02.039240 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2825b1-aa6d-4c11-98ca-c4c061636fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:02.056588 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4a2825b1-aa6d-4c11-98ca-c4c061636fbd None None] MFA Rules not processed for user `1c6c076588d9458784247cdfec12c4ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:02.057809 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4a2825b1-aa6d-4c11-98ca-c4c061636fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:02.064099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 746/1474] 10.222.0.10 () {58 vars in 1059 bytes} [Fri Jun 10 12:59:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:59:02.071846 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a935e-96db-4a7f-99a0-a442ce005614 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:02.082153 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a935e-96db-4a7f-99a0-a442ce005614 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:02.086227 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6c076588d9458784247cdfec12c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:02.086845 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:02.087128 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:02.087406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:02.096232 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:02.097692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e47ea-76aa-434e-814a-66e031b58d2f service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:02.107165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1475] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:59:04.308311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bde7-8ec3-4ea3-bea7-af1f98506814 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:04.308911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bde7-8ec3-4ea3-bea7-af1f98506814 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:04.308911 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983bde7-8ec3-4ea3-bea7-af1f98506814 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:04.310323 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 747/1476] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:04.315606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065df01-c209-4611-a5f0-23c16f36c635 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:04.316129 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065df01-c209-4611-a5f0-23c16f36c635 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:04.316231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065df01-c209-4611-a5f0-23c16f36c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:04.335080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9065df01-c209-4611-a5f0-23c16f36c635 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:04.336431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9065df01-c209-4611-a5f0-23c16f36c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:04.344513 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1477] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:59:04.368289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983bde7-8ec3-4ea3-bea7-af1f98506814 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:04.380773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983bde7-8ec3-4ea3-bea7-af1f98506814 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:04.385182 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:04.385825 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:04.386104 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:04.386375 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:04.387099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:04.388902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 12:59:04.388902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 12:59:04.388902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 12:59:04.390048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc1b61-1325-4a56-91ca-0955a5608dcd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:04.409529 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 748/1478] 10.222.0.10 () {56 vars in 1108 bytes} [Fri Jun 10 12:59:04 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 12:59:06.555199 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5c25-3879-4138-b077-5f969b73af37 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:06.555808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5c25-3879-4138-b077-5f969b73af37 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:06.555808 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf5c25-3879-4138-b077-5f969b73af37 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:06.557198 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1479] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:06.562478 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491a15-ae7f-4b10-8edf-c37854e5dfbc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:06.562894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491a15-ae7f-4b10-8edf-c37854e5dfbc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:06.563055 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491a15-ae7f-4b10-8edf-c37854e5dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:06.580867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3491a15-ae7f-4b10-8edf-c37854e5dfbc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:06.582049 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3491a15-ae7f-4b10-8edf-c37854e5dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:06.590343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 749/1480] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:59:06.635206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5c25-3879-4138-b077-5f969b73af37 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:06.649896 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf5c25-3879-4138-b077-5f969b73af37 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:06.655359 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:06.655981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:06.656264 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:06.656536 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:06.664530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:06.666172 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd889a-3c8a-4a7c-9c62-e31c41c1a9b2 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:06.675314 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1481] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:59:08.951891 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410bd9-8ab8-42fd-8465-1700132ef445 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:08.952436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410bd9-8ab8-42fd-8465-1700132ef445 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:08.952436 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410bd9-8ab8-42fd-8465-1700132ef445 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:08.953768 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 750/1482] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:08.959038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71fb6-9d57-467b-b7e9-1451ec1a533f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:08.963229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71fb6-9d57-467b-b7e9-1451ec1a533f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:08.963229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b71fb6-9d57-467b-b7e9-1451ec1a533f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:08.978326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e8b71fb6-9d57-467b-b7e9-1451ec1a533f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:08.979508 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e8b71fb6-9d57-467b-b7e9-1451ec1a533f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:08.987312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1483] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:59:09.024567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410bd9-8ab8-42fd-8465-1700132ef445 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:09.035676 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410bd9-8ab8-42fd-8465-1700132ef445 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:09.039668 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:09.040287 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:09.040573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:09.040883 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:09.049766 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:09.051216 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b6354-fbe8-438b-b078-e1ecafebcb51 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:09.060858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 751/1484] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:59:11.280959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a40ad-0f37-481c-9f62-afed05b6e3ea None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:11.281517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a40ad-0f37-481c-9f62-afed05b6e3ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:11.281517 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a40ad-0f37-481c-9f62-afed05b6e3ea None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:11.282874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1485] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:11.288858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337324a9-0c2f-45a1-90e5-7c67c18a3879 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:11.289297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337324a9-0c2f-45a1-90e5-7c67c18a3879 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:11.289426 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337324a9-0c2f-45a1-90e5-7c67c18a3879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:11.307505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-337324a9-0c2f-45a1-90e5-7c67c18a3879 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:11.308740 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-337324a9-0c2f-45a1-90e5-7c67c18a3879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:11.316376 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 752/1486] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:59:11.355013 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a40ad-0f37-481c-9f62-afed05b6e3ea None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:11.366237 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a40ad-0f37-481c-9f62-afed05b6e3ea None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:11.369774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:11.370398 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:11.370674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:11.370957 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:11.379542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:11.381001 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e879b19-18ec-431a-922f-276c56a96947 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:11.390182 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1487] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:59:13.638670 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc7c4-5741-487b-9b2f-39ad0b98e95f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:13.639139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc7c4-5741-487b-9b2f-39ad0b98e95f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:13.639249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcc7c4-5741-487b-9b2f-39ad0b98e95f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:13.640639 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 753/1488] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 12:59:13.645859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31b9b-4376-4a62-845b-e41beffd0426 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:13.646263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31b9b-4376-4a62-845b-e41beffd0426 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:13.646418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb31b9b-4376-4a62-845b-e41beffd0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:13.664329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9cb31b9b-4376-4a62-845b-e41beffd0426 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:13.665566 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9cb31b9b-4376-4a62-845b-e41beffd0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:13.673259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1489] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 12:59:13.714017 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcc7c4-5741-487b-9b2f-39ad0b98e95f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:13.724535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcc7c4-5741-487b-9b2f-39ad0b98e95f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:13.728685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:13.729311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:13.729595 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:13.729870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:13.738617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:13.740064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33b63e-5c03-4a05-970f-c90597382d64 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:13.749184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 754/1490] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 12:59:16.246406 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb735-f9b0-4956-b451-5cf960fcda2d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:16.246983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb735-f9b0-4956-b451-5cf960fcda2d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:16.246983 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb735-f9b0-4956-b451-5cf960fcda2d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:16.248322 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1491] 10.222.0.10 () {54 vars in 926 bytes} [Fri Jun 10 12:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 12:59:16.253505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab7e9-443e-406e-9457-1a847a97a39f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:16.253898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab7e9-443e-406e-9457-1a847a97a39f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:16.254067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab7e9-443e-406e-9457-1a847a97a39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:16.272050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-156ab7e9-443e-406e-9457-1a847a97a39f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 12:59:16.273358 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-156ab7e9-443e-406e-9457-1a847a97a39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 12:59:16.281326 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 755/1492] 10.222.0.10 () {58 vars in 1023 bytes} [Fri Jun 10 12:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 12:59:16.320690 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb735-f9b0-4956-b451-5cf960fcda2d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 12:59:16.331189 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb735-f9b0-4956-b451-5cf960fcda2d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 12:59:16.334649 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 12:59:16.335266 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 12:59:16.335543 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 12:59:16.335810 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 12:59:16.344462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 12:59:16.345904 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f7d36-e8fe-470d-bed6-1c84e8c09472 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 12:59:16.355531 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1493] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 12:59:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 12:59:26.266944 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=33 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 12:59:26.351491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:00:49.507605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.508297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.508297 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.526818 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:00:49.528021 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:49.536243 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 756/1494] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:00:49.545368 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.545881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.545985 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.563603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:00:49.571854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:49.573136 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1495] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:00:49.577566 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.588094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada94d71-3e87-4bd7-95f5-23c696151f9a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.592937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.593617 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.593898 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.594171 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.594925 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 13:00:49.595234 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:49.596275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:49.596275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:00:49.596275 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:00:49.597301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:49.609139 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 757/1496] 10.222.0.10 () {58 vars in 1152 bytes} [Fri Jun 10 13:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 13:00:49.617803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.627021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1b355-037b-4dab-b16d-5ad62bae1b7f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.632291 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.633031 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.633306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.633575 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.634387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:49.636132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:49.636132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:00:49.636132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:00:49.637379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:49.749407 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1497] 10.222.0.10 () {60 vars in 1152 bytes} [Fri Jun 10 13:00:49 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 13:00:49.754339 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.764129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069194-a98e-498a-a89d-f826468ae94e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.818887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.819550 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.819836 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.820114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.820842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:49.821851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:49.821851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:00:49.821851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:00:49.823058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:49.907826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 758/1498] 10.222.0.10 () {60 vars in 1143 bytes} [Fri Jun 10 13:00:49 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 13:00:49.911842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.921966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953c995-b98c-409b-89db-c942021bad9e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.927281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:00:49.934885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:00:49.935501 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:49.944160 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1499] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:00:49.948263 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.958046 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f756b-3994-4d98-8bbf-8d46cd71360d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.962511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.963159 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.963444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.963720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:49.964437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:49.965464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:49.965464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:00:49.965464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:00:49.966354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b51d4-c341-4200-ae95-d2a78c0c685a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:49.979561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 759/1500] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:00:49.983506 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:49.993849 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb51f27-4fb7-493c-bc39-dbe1105df040 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:49.998255 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:49.999123 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:49.999408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:49.999682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] PATH_INFO: `/v3/projects/b5d2e206e6564a42858cd2db1890e326/users/f64201ce18284b51bd6c6ae036a9c896/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.014937 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d2e206e6564a42858cd2db1890e326, user_id=f64201ce18284b51bd6c6ae036a9c896, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:50.015942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:50.015942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:00:50.015942 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:00:50.017945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cd7b3-2b76-4f74-9eb2-4112ac76fbed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:50.096397 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1501] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:00:49 2022] PUT /identity/v3/projects/b5d2e206e6564a42858cd2db1890e326/users/f64201ce18284b51bd6c6ae036a9c896/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:00:50.107937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125872-1092-44d6-b547-1dc66ea8a09d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.108261 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125872-1092-44d6-b547-1dc66ea8a09d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.108542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125872-1092-44d6-b547-1dc66ea8a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.137219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4b125872-1092-44d6-b547-1dc66ea8a09d None None] MFA Rules not processed for user `f64201ce18284b51bd6c6ae036a9c896`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:00:50.138432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4b125872-1092-44d6-b547-1dc66ea8a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:50.204479 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 760/1502] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:00:50.218434 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed97ad-4090-4216-bb6b-cbf291426522 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.218721 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed97ad-4090-4216-bb6b-cbf291426522 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.219002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ed97ad-4090-4216-bb6b-cbf291426522 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.220416 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1503] 10.222.0.10 () {54 vars in 963 bytes} [Fri Jun 10 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:00:50.225868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b489-0567-4c59-8dad-8097c453e668 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.226168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b489-0567-4c59-8dad-8097c453e668 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.226452 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8b489-0567-4c59-8dad-8097c453e668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.245872 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2be8b489-0567-4c59-8dad-8097c453e668 None None] MFA Rules not processed for user `d39acd104e2b41119ce9454dbb4428ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:00:50.247092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2be8b489-0567-4c59-8dad-8097c453e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:50.292803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:00:50.299995 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 761/1504] 10.222.0.10 () {58 vars in 1060 bytes} [Fri Jun 10 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:00:50.308922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed97ad-4090-4216-bb6b-cbf291426522 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:50.319408 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ed97ad-4090-4216-bb6b-cbf291426522 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:50.322876 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd39acd104e2b41119ce9454dbb4428ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:50.323500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.323821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.324098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.332379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:50.333813 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:50.342366 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1505] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:00:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:00:50.386161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796b4c-88ea-45f6-9f2d-81325aa02514 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.386475 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796b4c-88ea-45f6-9f2d-81325aa02514 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.386760 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be796b4c-88ea-45f6-9f2d-81325aa02514 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.388036 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 762/1506] 10.222.0.10 () {52 vars in 829 bytes} [Fri Jun 10 13:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:00:50.391580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:50.457352 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b39da-a2d6-44fa-bc82-ba6ebe7c0035 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:50.461880 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:50.462818 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.463270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.463550 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] PATH_INFO: `/v3/users/f64201ce18284b51bd6c6ae036a9c896` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.464786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64201ce18284b51bd6c6ae036a9c896)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:50.465821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:50.465821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:00:50.465821 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:00:50.467039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:50.759608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64201ce18284b51bd6c6ae036a9c896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:50.779037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64201ce18284b51bd6c6ae036a9c896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:50.792326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64201ce18284b51bd6c6ae036a9c896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:50.796401 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:00:50.904270 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64201ce18284b51bd6c6ae036a9c896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:50.904946 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64201ce18284b51bd6c6ae036a9c896'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:50.911343 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1507] 10.222.0.10 () {58 vars in 1223 bytes} [Fri Jun 10 13:00:50 2022] DELETE /identity/v3/users/f64201ce18284b51bd6c6ae036a9c896 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:00:50.915964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:50.916407 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:50.916525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:50.933700 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:00:50.934894 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:50.992190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 763/1508] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:00:51.001591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:51.003030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:51.059442 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bddb1-eb89-4386-90e8-d97589707360 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:51.063060 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:51.063765 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:51.064045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:51.068994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:51.073884 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:51.075302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb8a7-c436-494c-86a5-00517192f508 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:51.085165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1509] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:00:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:00:51.579690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:00:51.579964 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:00:51.591674 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541125-73ba-472d-9350-f3f90dc3cb96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:00:51.596371 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:00:51.597803 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:00:51.598179 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:00:51.598455 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] PATH_INFO: `/v3/projects/b5d2e206e6564a42858cd2db1890e326` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:00:51.599663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d2e206e6564a42858cd2db1890e326)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:00:51.600708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:00:51.600708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:00:51.600708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:00:51.601905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:00:51.726435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d2e206e6564a42858cd2db1890e326', 'request_id': 'req-70bf1562-b502-42a5-8f72-279859c25376'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:51.740611 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d2e206e6564a42858cd2db1890e326', 'request_id': 'req-70bf1562-b502-42a5-8f72-279859c25376'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:51.852936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d2e206e6564a42858cd2db1890e326', 'request_id': 'req-70bf1562-b502-42a5-8f72-279859c25376'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:51.864812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] The token cache is being invalidate because project b5d2e206e6564a42858cd2db1890e326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 10 13:00:51.865102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:51.865731 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-70bf1562-b502-42a5-8f72-279859c25376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:00:51.867373 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 764/1510] 10.222.0.10 () {58 vars in 1232 bytes} [Fri Jun 10 13:00:51 2022] DELETE /identity/v3/projects/b5d2e206e6564a42858cd2db1890e326 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:01:01.080388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:01:01.860975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:02:06.006750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:06.007312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:06.007312 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:06.008677 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 13:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:06.013464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db83a-5273-48ac-96cd-3df28ffc56a0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:06.013905 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db83a-5273-48ac-96cd-3df28ffc56a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:06.014011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db83a-5273-48ac-96cd-3df28ffc56a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:06.032099 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-aa1db83a-5273-48ac-96cd-3df28ffc56a0 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:06.033331 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aa1db83a-5273-48ac-96cd-3df28ffc56a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:06.093362 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:06.263628 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:06.265431 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:06.341196 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88f0c-ecdc-4b24-93ac-a39c697dc5e9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:06.346436 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:06.347070 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:06.347350 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:06.347620 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:06.356385 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:06.357999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5f5b1-821c-4834-bade-08501c496cce service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:06.367325 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1513] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:07.240267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b72549-542f-44b5-92fd-7c79d1891dce None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:07.240846 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b72549-542f-44b5-92fd-7c79d1891dce None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:07.240938 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b72549-542f-44b5-92fd-7c79d1891dce None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:07.242392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 13:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:07.247527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c572-a78b-4ad1-b6db-ea2d511eef73 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:07.247973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c572-a78b-4ad1-b6db-ea2d511eef73 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:07.248094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1c572-a78b-4ad1-b6db-ea2d511eef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:07.266221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-79b1c572-a78b-4ad1-b6db-ea2d511eef73 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:07.267415 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-79b1c572-a78b-4ad1-b6db-ea2d511eef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:07.276012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 13:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:07.432291 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b72549-542f-44b5-92fd-7c79d1891dce None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:07.446730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b72549-542f-44b5-92fd-7c79d1891dce None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:07.452050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:07.452702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:07.452986 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:07.453256 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:07.461987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:07.463560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630919e-2c64-4051-b177-29edde4170f2 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:07.472707 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 767/1516] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:10.249079 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeb6d-4d13-42d0-b4e5-8033fcd7f51e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:10.249661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeb6d-4d13-42d0-b4e5-8033fcd7f51e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:10.249661 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214eeb6d-4d13-42d0-b4e5-8033fcd7f51e None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:10.250955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1517] 10.222.0.26 () {54 vars in 925 bytes} [Fri Jun 10 13:02:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 10 13:02:10.257514 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1652e4-9e34-4149-80e0-779dc3590b78 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:10.257955 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1652e4-9e34-4149-80e0-779dc3590b78 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:10.258061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1652e4-9e34-4149-80e0-779dc3590b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:10.276692 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3c1652e4-9e34-4149-80e0-779dc3590b78 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:10.278143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3c1652e4-9e34-4149-80e0-779dc3590b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:10.338101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 768/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jun 10 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:17.261054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=37 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:02:18.735099 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0715c9-9346-4967-8923-3a9097609737 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:18.735767 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0715c9-9346-4967-8923-3a9097609737 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:18.735958 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0715c9-9346-4967-8923-3a9097609737 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:18.738329 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1519] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 13:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:18.743592 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a08347-a4b6-4dd7-acb8-e7bdb0433b67 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:18.744079 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a08347-a4b6-4dd7-acb8-e7bdb0433b67 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:18.744188 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a08347-a4b6-4dd7-acb8-e7bdb0433b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:18.762719 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-59a08347-a4b6-4dd7-acb8-e7bdb0433b67 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:18.763941 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-59a08347-a4b6-4dd7-acb8-e7bdb0433b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:18.772720 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 769/1520] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:18.928448 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0715c9-9346-4967-8923-3a9097609737 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:18.943831 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0715c9-9346-4967-8923-3a9097609737 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:18.949917 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:18.950565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:18.950844 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:18.951118 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:18.959851 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:18.961463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b6116-ba00-4f9f-89af-da29fc90f835 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:18.970922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1521] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 13:02:19.332276 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542e94-0250-4830-885c-790e108bb6cf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:19.332709 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542e94-0250-4830-885c-790e108bb6cf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:19.333098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7542e94-0250-4830-885c-790e108bb6cf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:19.334543 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 770/1522] 10.222.0.10 () {54 vars in 960 bytes} [Fri Jun 10 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:19.339665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39fe7-20ae-4529-aa3b-71e795dbe3aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:19.339959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39fe7-20ae-4529-aa3b-71e795dbe3aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:19.340239 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b39fe7-20ae-4529-aa3b-71e795dbe3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:19.358895 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-33b39fe7-20ae-4529-aa3b-71e795dbe3aa None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:19.360284 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33b39fe7-20ae-4529-aa3b-71e795dbe3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:19.369750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1523] 10.222.0.10 () {58 vars in 1057 bytes} [Fri Jun 10 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:19.377184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7542e94-0250-4830-885c-790e108bb6cf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:19.390567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7542e94-0250-4830-885c-790e108bb6cf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:19.395481 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:19.396473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:19.396795 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:19.397078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:19.405733 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:19.407437 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7d18b-db93-4ca7-9464-629f69e1c38b service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:19.418148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 771/1524] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:19.864698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c196d-b52a-4445-89fd-b38b9e91be68 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:19.865208 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c196d-b52a-4445-89fd-b38b9e91be68 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:19.865302 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c196d-b52a-4445-89fd-b38b9e91be68 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:19.866632 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 10 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 13:02:19.871521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9198-31bd-4b10-a292-6a5193f1454d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:19.871928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9198-31bd-4b10-a292-6a5193f1454d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:19.872141 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9198-31bd-4b10-a292-6a5193f1454d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:19.889796 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cd0c9198-31bd-4b10-a292-6a5193f1454d None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:19.891011 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd0c9198-31bd-4b10-a292-6a5193f1454d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:19.899496 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 10 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:20.059186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c196d-b52a-4445-89fd-b38b9e91be68 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:20.074695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c196d-b52a-4445-89fd-b38b9e91be68 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:20.080072 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:20.080745 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:20.081030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:20.081761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:20.090521 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:20.092106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e91546-e0a6-4a16-a592-c1ea16bb41b6 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:20.101758 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1527] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:24.220008 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:24.220678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:24.220678 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:24.221974 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 13:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:24.227288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cc24-f652-444c-80de-78777658af25 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:24.227698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cc24-f652-444c-80de-78777658af25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:24.227827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963cc24-f652-444c-80de-78777658af25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:24.245827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d963cc24-f652-444c-80de-78777658af25 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:24.246999 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d963cc24-f652-444c-80de-78777658af25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:24.254607 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 13:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:24.292569 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:24.294299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:24.351634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6829f-332d-44bf-8630-677408cbc980 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:24.355148 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:24.355785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:24.356072 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:24.356350 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:24.365674 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:24.367130 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12161c8-8e16-4b25-ac61-ed9c64bb4041 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:24.372202 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:02:24.377161 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 774/1530] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:26.492874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bdf40-e759-465c-849f-a683e93f2efd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:26.493455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bdf40-e759-465c-849f-a683e93f2efd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:26.493455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bdf40-e759-465c-849f-a683e93f2efd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:26.494938 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 13:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:26.500020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60a8a-e1a1-4139-bbf4-905a1e3bda72 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:26.500444 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60a8a-e1a1-4139-bbf4-905a1e3bda72 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:26.500584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c60a8a-e1a1-4139-bbf4-905a1e3bda72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:26.519067 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-07c60a8a-e1a1-4139-bbf4-905a1e3bda72 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:26.520285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-07c60a8a-e1a1-4139-bbf4-905a1e3bda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:26.528265 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:26.564193 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bdf40-e759-465c-849f-a683e93f2efd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:26.575404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bdf40-e759-465c-849f-a683e93f2efd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:26.578859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:26.579481 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:26.579761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:26.580032 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:26.588638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:26.590241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512952ac-fa89-4de7-89fc-515c1b36f0b0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:26.599491 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1533] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:30.144221 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:30.144830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:30.144830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:30.146235 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 13:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:30.151419 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc73a-6d70-4b4f-94cb-e82b0efdcf6c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:30.151853 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc73a-6d70-4b4f-94cb-e82b0efdcf6c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:30.151966 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc73a-6d70-4b4f-94cb-e82b0efdcf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:30.170068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-701fc73a-6d70-4b4f-94cb-e82b0efdcf6c None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:30.171257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-701fc73a-6d70-4b4f-94cb-e82b0efdcf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:30.179433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:30.470125 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:30.471849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:30.533773 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6bf36-1a9f-46e8-9325-bcee0dc906d5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:30.538034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd39acd104e2b41119ce9454dbb4428ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:30.538681 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:30.539904 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:30.540187 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:30.549597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:30.551064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33f6bc-07a5-48ee-8b14-a8e57962f306 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:30.562156 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 777/1536] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:32.745943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:32.746480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:32.746591 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:32.747922 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 10 13:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:02:32.753348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3100-c725-42a1-9b00-3db71f64f51f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:32.753738 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3100-c725-42a1-9b00-3db71f64f51f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:32.753936 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c3100-c725-42a1-9b00-3db71f64f51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:32.771710 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-581c3100-c725-42a1-9b00-3db71f64f51f None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:02:32.772926 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-581c3100-c725-42a1-9b00-3db71f64f51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:32.780799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 10 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:02:33.045378 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:02:33.047109 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:02:33.060959 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fe597-91c8-4a6c-bb14-ae1a5c844704 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:02:33.064524 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd39acd104e2b41119ce9454dbb4428ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:02:33.065181 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:02:33.065463 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:02:33.065738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:02:33.075064 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:02:33.076528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e9273-2e5c-4632-8762-2c6abf6d9e62 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:02:33.086695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1539] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:02:42.766433 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=32 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:02:43.081790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=33 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:03:55.802790 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623d26-75cd-468f-b4d9-598cb769f735 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.803396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623d26-75cd-468f-b4d9-598cb769f735 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.803396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31623d26-75cd-468f-b4d9-598cb769f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.821629 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-31623d26-75cd-468f-b4d9-598cb769f735 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:55.822819 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-31623d26-75cd-468f-b4d9-598cb769f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:55.830653 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 779/1540] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:03:55.839993 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.840519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.840706 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.856907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ea5f-780c-4b70-b6c9-e7801ff43cd1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.857191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ea5f-780c-4b70-b6c9-e7801ff43cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.857473 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267ea5f-780c-4b70-b6c9-e7801ff43cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.858374 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:55.859564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:55.867892 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1541] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:03:55.872303 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:55.875919 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2267ea5f-780c-4b70-b6c9-e7801ff43cd1 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:55.877129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2267ea5f-780c-4b70-b6c9-e7801ff43cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:55.881854 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b1098-51a7-4dab-abe0-7824d85c5dbc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:55.885901 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 780/1542] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:03:55.886672 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:55.887327 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.887612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.887888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.888608 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 13:03:55.888943 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:55.889955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:03:55.889955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:03:55.889955 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:03:55.890833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:55.894590 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.894877 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.895206 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.903514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1543] 10.222.0.10 () {58 vars in 1152 bytes} [Fri Jun 10 13:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 13:03:55.912130 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:55.913840 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:55.915034 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:55.922151 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23486d3b-861c-4f6a-a41e-3b53102aa1c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:55.922835 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 781/1544] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:03:55.927420 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:55.927799 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:55.928067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.928344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.928644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.929376 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:55.931263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:55.936742 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c418d-752e-4d78-ad41-5be1c4fc48ca None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:55.941191 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:55.941834 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.942116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.942392 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.943107 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 10 13:03:55.943417 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:55.945042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:55.956394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 782/1545] 10.222.0.10 () {58 vars in 1152 bytes} [Fri Jun 10 13:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 10 13:03:55.964525 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:55.974597 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1147d4e-fe7a-4cb2-ad9e-935041688958 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:55.979323 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:55.979954 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:55.980237 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:55.980559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:55.981301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:55.982327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:03:55.982327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:03:55.982327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:03:55.983501 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.036801 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1546] 10.222.0.10 () {60 vars in 1152 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 13:03:56.040348 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.060925 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 783/1547] 10.222.0.10 () {60 vars in 1152 bytes} [Fri Jun 10 13:03:55 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 13:03:56.063708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.102794 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d6e2-4d7d-488c-8f5f-f7af9570a951 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.125785 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698c6b2-64d5-40cd-9aef-342ea0597870 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.131254 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.131916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.132197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.132472 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.133190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.135098 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.158424 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.159097 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.159381 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.159659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.160915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.161929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:03:56.161929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:03:56.161929 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:03:56.163148 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.204900 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 784/1548] 10.222.0.10 () {60 vars in 1143 bytes} [Fri Jun 10 13:03:56 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 13:03:56.208932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.218146 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66347ade-c49e-4ce2-aa23-1e80c49fb0b0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.223200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.223826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.224112 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.224391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.225131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.226722 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.240012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1549] 10.222.0.10 () {60 vars in 1143 bytes} [Fri Jun 10 13:03:56 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 13:03:56.240194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 785/1550] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 13:03:56.240976 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.241102 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.251154 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64898e0c-0feb-4c5f-8652-8e062ad76a87 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.251394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795144c-a8e0-4fb4-a479-e69fca02c62e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.256020 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.256198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.256709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.256862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.257000 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.257131 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.257277 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.257401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.258022 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.258137 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.259605 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.259741 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.270335 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 786/1552] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:03:56.270494 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1552] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:03:56.274405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.274567 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.284396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba8824-ed6e-4631-bba7-4fd37231e01b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.284598 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf93169-e6e6-4194-8a81-58649f8d1725 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.289776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.294341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.294341 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.294730 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.294843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.294947 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.295037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.295145 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] PATH_INFO: `/v3/projects/fb1fb12769ea48e4ad7fe4a590095671/users/afbd90eaa6344685b0cc079ca45df361/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.295233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.295233 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.305203 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1553] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 13:03:56.307390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1fb12769ea48e4ad7fe4a590095671, user_id=afbd90eaa6344685b0cc079ca45df361, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.308549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:03:56.308549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:03:56.308549 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:03:56.309538 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.310542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552fef9-c576-4664-aceb-57b264f35368 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.323713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b492f-93fd-4be7-a1ae-b0233f7066d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.323885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.324685 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.324974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.325251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] PATH_INFO: `/v3/projects/0ab8b4d01c9947b591bf9299967a6c28/users/a7ccace9d07f4bbb802b288510d78f73/roles/fd48ed2e35674327b4449b3be67d32c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.339907 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab8b4d01c9947b591bf9299967a6c28, user_id=a7ccace9d07f4bbb802b288510d78f73, role_id=fd48ed2e35674327b4449b3be67d32c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.342599 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728a201-ffb0-4ee6-802b-8ca4ecce8d4c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.376143 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 787/1554] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:03:56 2022] PUT /identity/v3/projects/fb1fb12769ea48e4ad7fe4a590095671/users/afbd90eaa6344685b0cc079ca45df361/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 13:03:56.381250 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.381536 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.381820 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.398302 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:56.399490 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:56.439354 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1555] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:03:56 2022] PUT /identity/v3/projects/0ab8b4d01c9947b591bf9299967a6c28/users/a7ccace9d07f4bbb802b288510d78f73/roles/fd48ed2e35674327b4449b3be67d32c4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:03:56.443115 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:03:56.444474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.444797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.445080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.458841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 788/1556] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:03:56.461908 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] MFA Rules not processed for user `b7bb6edd4f154eb88b778d90110b667e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:03:56.463116 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:56.467106 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:03:56.473427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.473427 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:03:56.522258 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1557] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:03:56.528937 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445001e9-131d-47ab-90f2-f85d27778794 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.532260 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:03:56.577344 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.578002 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.578348 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.578628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.586945 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701a859-f8be-45c1-889b-fddf9a0cf831 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:03:56.588560 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.590048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6e648-5af2-4c2e-908d-99c8e30efac8 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.590650 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:03:56.591290 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:03:56.591568 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:03:56.591838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:03:56.600521 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 789/1558] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 13:03:56.601750 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:03:56.603206 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:03:56.613981 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1559] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 13:04:02.797908 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:02.798455 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:02.798821 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:02.859777 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:02.861168 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:02.968414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 790/1560] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:02.973404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:02.983337 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cee6c-a6c2-4176-82ec-89330d009f70 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:02.989098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:02.989768 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:02.990046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:02.990321 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:02.991021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:02.993028 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0972a-e294-4b67-a7d1-35a31ebf845a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.111452 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1561] 10.222.0.10 () {60 vars in 1152 bytes} [Fri Jun 10 13:04:02 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 13:04:03.117278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.133058 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0876a-ce1b-425e-ac54-60af0fde1fa7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.201228 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:03.239438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.240564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.241138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.241634 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.243380 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.246311 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.354500 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.354797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.355083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.361120 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 791/1562] 10.222.0.10 () {60 vars in 1143 bytes} [Fri Jun 10 13:04:03 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 10 13:04:03.365520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.377464 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b418b2-22ac-4ab3-be97-5201f0e2776d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.383712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.384387 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.384776 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.385121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.385924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.387826 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.391881 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] MFA Rules not processed for user `a7ccace9d07f4bbb802b288510d78f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:03.393468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:03.399447 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 792/1563] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 13:04:03.403602 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.415517 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cefd5b-6b53-46e5-970c-9bcc7ab2dc9f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.421114 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.422004 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.422288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.422685 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] PATH_INFO: `/v3/projects/7ad9a030899b4b1183443aeb2238c37a/users/b25be400236b4ed98c7d66cd58bc522b/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.440040 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9a030899b4b1183443aeb2238c37a, user_id=b25be400236b4ed98c7d66cd58bc522b, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.442963 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.479090 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1564] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:04:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:03.483301 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.498241 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859c65-f2d9-4b4d-a253-b7be175a6694 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.502874 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.503656 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.504055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.504468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.505243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.507186 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.514902 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 793/1565] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:04:03 2022] PUT /identity/v3/projects/7ad9a030899b4b1183443aeb2238c37a/users/b25be400236b4ed98c7d66cd58bc522b/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 10 13:04:03.520295 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.590661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ffa43-3e2b-4fd2-8a92-93e31c7b3acd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.594439 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:03.595552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.596253 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.596540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.596858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.598201 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.599868 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.603912 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1566] 10.222.0.10 () {60 vars in 1152 bytes} [Fri Jun 10 13:04:03 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 13:04:03.608062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.616564 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 794/1567] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:04:03.618355 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.627912 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a81417f-6a22-4029-a2c4-cc8506274cfe admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.695924 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.697808 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.698623 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.699330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] PATH_INFO: `/v3/projects/7ad9a030899b4b1183443aeb2238c37a/users/b25be400236b4ed98c7d66cd58bc522b/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.701386 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65495-4c70-4aa5-bb72-8d5af8d99a52 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.701916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad9a030899b4b1183443aeb2238c37a, user_id=b25be400236b4ed98c7d66cd58bc522b, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.707333 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.707540 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.708138 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.709119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.709119 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.709842 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.713288 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.724023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 795/1568] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:04:03 2022] PUT /identity/v3/projects/7ad9a030899b4b1183443aeb2238c37a/users/b25be400236b4ed98c7d66cd58bc522b/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:04:03.782974 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1569] 10.222.0.10 () {60 vars in 1143 bytes} [Fri Jun 10 13:04:03 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 10 13:04:03.786929 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.817309 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:03.861654 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51afaa-7171-4e43-a49b-3e2314045924 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.870394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.870394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.870394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.870394 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.870771 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.872493 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:03.886096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 796/1570] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 10 13:04:03.895642 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:03.907600 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49dec-e12d-4b5f-a657-e5173b3e89ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:03.914890 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:03.916400 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:03.916726 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:03.922063 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] PATH_INFO: `/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc/users/86df990df0e54e858b30d7338a56b931/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:03.945488 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dee49723891429ba3cf1a3c8ce65ecc, user_id=86df990df0e54e858b30d7338a56b931, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:03.951437 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:04.039799 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1571] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:04:03 2022] PUT /identity/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc/users/86df990df0e54e858b30d7338a56b931/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:04:04.044783 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:04.058648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699276a-7bea-4062-8a15-5f3711491e65 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:04.168135 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:04.168871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:04.169163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:04.169435 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:04.170163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:04.172089 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4e23e-b767-4972-855e-ec2476181977 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:04.194280 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 797/1572] 10.222.0.10 () {58 vars in 1121 bytes} [Fri Jun 10 13:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 10 13:04:04.195973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:04.211433 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb739ba-dd99-4fe8-bbd5-a8689b4e09c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:04.228197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:04.229166 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:04.229505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:04.229772 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] PATH_INFO: `/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc/users/86df990df0e54e858b30d7338a56b931/roles/0e72028c9daf424e8cf295e12a9e4109` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:04.232120 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dee49723891429ba3cf1a3c8ce65ecc, user_id=86df990df0e54e858b30d7338a56b931, role_id=0e72028c9daf424e8cf295e12a9e4109)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:04.235112 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:04.249973 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1573] 10.222.0.10 () {60 vars in 1482 bytes} [Fri Jun 10 13:04:04 2022] PUT /identity/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc/users/86df990df0e54e858b30d7338a56b931/roles/0e72028c9daf424e8cf295e12a9e4109 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:04:10.758030 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad098-89e8-4abd-b922-d177aceada2b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:10.758609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad098-89e8-4abd-b922-d177aceada2b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:10.758609 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad098-89e8-4abd-b922-d177aceada2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:10.812589 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a98ad098-89e8-4abd-b922-d177aceada2b None None] MFA Rules not processed for user `b25be400236b4ed98c7d66cd58bc522b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:10.813879 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a98ad098-89e8-4abd-b922-d177aceada2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:10.959527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 798/1574] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:04:10.973740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:10.976387 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:11.068532 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2c769-c513-492e-a076-25d91469e52f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:11.072371 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6c076588d9458784247cdfec12c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:11.073480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:11.073833 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:11.074175 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:11.204580 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:11.208217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:11.236730 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1575] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:11.458591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e198bc-ccdf-4dac-ad64-050c4574752c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:11.458880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e198bc-ccdf-4dac-ad64-050c4574752c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:11.459165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e198bc-ccdf-4dac-ad64-050c4574752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:11.508270 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-88e198bc-ccdf-4dac-ad64-050c4574752c None None] MFA Rules not processed for user `86df990df0e54e858b30d7338a56b931`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:11.509542 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88e198bc-ccdf-4dac-ad64-050c4574752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:11.543663 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:11.588461 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 799/1576] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:11.603541 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:11.611665 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:11.618695 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529b74b-93f9-4aa4-8c67-3c21eccfe80b service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:11.626140 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6c076588d9458784247cdfec12c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:11.626953 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:11.628098 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:11.629310 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:11.712336 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:11.714100 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:11.735414 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1577] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:12.041702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf61a4-5d06-4c53-94b5-e69c8a7b9632 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:12.042182 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf61a4-5d06-4c53-94b5-e69c8a7b9632 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:12.042749 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf61a4-5d06-4c53-94b5-e69c8a7b9632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:12.063732 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2faf61a4-5d06-4c53-94b5-e69c8a7b9632 None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:12.065009 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2faf61a4-5d06-4c53-94b5-e69c8a7b9632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:12.127264 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 800/1578] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:12.392519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:12.394331 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:12.492722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252dc17-8084-48b2-8c6f-d2a3168f7b18 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:12.523474 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:12.524812 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:12.525485 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:12.525952 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:12.548010 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:12.553759 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:12.562377 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1579] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:04:13.385576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a62c-e50e-4a76-a9bc-e432f17da803 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:13.385576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a62c-e50e-4a76-a9bc-e432f17da803 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:13.385576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95a62c-e50e-4a76-a9bc-e432f17da803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:13.388203 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ee95a62c-e50e-4a76-a9bc-e432f17da803 None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:13.390190 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee95a62c-e50e-4a76-a9bc-e432f17da803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:13.407364 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 801/1580] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:13.420253 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:13.444530 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad3fe-5ea4-4f00-a00b-ce7a348e0bea service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:13.451219 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:13.452739 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:13.453187 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:13.454021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:13.470278 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:13.472197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c31678-c2cf-4c69-b718-1291aede84b9 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:13.484263 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1581] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:04:23.380775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=44 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:23.478638 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=64 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:24.501032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7ce1f-a0bf-43b1-9a79-28b0845f22f5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.501779 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7ce1f-a0bf-43b1-9a79-28b0845f22f5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.501957 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7ce1f-a0bf-43b1-9a79-28b0845f22f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:24.519111 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-28a7ce1f-a0bf-43b1-9a79-28b0845f22f5 None None] MFA Rules not processed for user `a7ccace9d07f4bbb802b288510d78f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:24.520306 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-28a7ce1f-a0bf-43b1-9a79-28b0845f22f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:24.527648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 802/1582] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:24.827018 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067de0-9d95-46c1-9a42-87e98a42ecf1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.828402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067de0-9d95-46c1-9a42-87e98a42ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.828402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067de0-9d95-46c1-9a42-87e98a42ecf1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:24.829041 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1583] 10.222.0.10 () {54 vars in 961 bytes} [Fri Jun 10 13:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:24.834679 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b220-6382-41d3-bcf7-9447b48da012 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.834972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b220-6382-41d3-bcf7-9447b48da012 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.835249 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9b220-6382-41d3-bcf7-9447b48da012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:24.853893 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cab9b220-6382-41d3-bcf7-9447b48da012 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:24.855088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cab9b220-6382-41d3-bcf7-9447b48da012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:24.920661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 803/1584] 10.222.0.10 () {58 vars in 1058 bytes} [Fri Jun 10 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:24.926962 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.927247 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.927523 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:24.928971 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1585] 10.222.0.10 () {54 vars in 912 bytes} [Fri Jun 10 13:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:24.934080 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df79-9d69-4a09-ad51-4b11e39dbbec None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.934370 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df79-9d69-4a09-ad51-4b11e39dbbec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.934649 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11df79-9d69-4a09-ad51-4b11e39dbbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:24.951961 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dc11df79-9d69-4a09-ad51-4b11e39dbbec None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:24.953198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc11df79-9d69-4a09-ad51-4b11e39dbbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:24.962842 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 804/1586] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:24.974688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:24.976394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:24.989038 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ae334-4f2b-45a6-a8d0-287d7ba1cdde None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:24.992515 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c6c076588d9458784247cdfec12c4ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:24.993169 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:24.993451 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:24.993722 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:25.003992 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:25.005565 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599678-e161-4fe0-98d3-7ec8b290ecb4 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:25.017055 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1587] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:25.447282 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc069-c4c7-4d54-bfa3-ef67257ede43 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:25.447572 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc069-c4c7-4d54-bfa3-ef67257ede43 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:25.447855 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efc069-c4c7-4d54-bfa3-ef67257ede43 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:25.449301 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 805/1588] 10.222.0.10 () {54 vars in 912 bytes} [Fri Jun 10 13:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:25.454405 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039d0b-6ba2-445d-aa54-69d16a1ebcf5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:25.454692 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039d0b-6ba2-445d-aa54-69d16a1ebcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:25.455021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039d0b-6ba2-445d-aa54-69d16a1ebcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:25.491630 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e3039d0b-6ba2-445d-aa54-69d16a1ebcf5 None None] MFA Rules not processed for user `2fda4f42ba344b4f960ed39a006b887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:25.500905 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3039d0b-6ba2-445d-aa54-69d16a1ebcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:25.542468 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1589] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:25.555664 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc069-c4c7-4d54-bfa3-ef67257ede43 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:25.566816 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efc069-c4c7-4d54-bfa3-ef67257ede43 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:25.570443 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:25.571081 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:25.571366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:25.571643 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:25.579165 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:25.580601 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc758899-575c-4915-9792-429b10c8dbc0 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:25.589798 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 806/1590] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:26.067769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad4ed-5b13-421c-b666-e06b934e6f4d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.068177 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad4ed-5b13-421c-b666-e06b934e6f4d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.068564 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dad4ed-5b13-421c-b666-e06b934e6f4d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.070122 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1591] 10.222.0.10 () {54 vars in 961 bytes} [Fri Jun 10 13:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:26.075767 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485db5-f9fa-4bba-a8ef-506f22dd4e37 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.076078 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485db5-f9fa-4bba-a8ef-506f22dd4e37 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.076354 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9485db5-f9fa-4bba-a8ef-506f22dd4e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.080674 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a52c5-4384-4c2b-b8c6-4641b6d0c50b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.081576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a52c5-4384-4c2b-b8c6-4641b6d0c50b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.081875 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a52c5-4384-4c2b-b8c6-4641b6d0c50b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.083388 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1592] 10.222.0.10 () {54 vars in 960 bytes} [Fri Jun 10 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:26.088436 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.088783 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.089068 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.095591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c9485db5-f9fa-4bba-a8ef-506f22dd4e37 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:26.096899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c9485db5-f9fa-4bba-a8ef-506f22dd4e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:26.108271 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 807/1593] 10.222.0.10 () {58 vars in 1058 bytes} [Fri Jun 10 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:26.113880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878421ef-0a63-4b42-8e97-77a048f813a4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.114244 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878421ef-0a63-4b42-8e97-77a048f813a4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.114585 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878421ef-0a63-4b42-8e97-77a048f813a4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.116116 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 808/1594] 10.222.0.10 () {54 vars in 912 bytes} [Fri Jun 10 13:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 10 13:04:26.116473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:26.117761 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:26.121183 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.121491 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.121764 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.140167 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:26.141399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:26.151074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 809/1595] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:04:26.163690 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:26.178023 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933d430-42b8-4be3-8276-af9bc5a78525 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:26.182077 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:26.182824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.183175 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.183520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.186165 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1596] 10.222.0.10 () {58 vars in 1057 bytes} [Fri Jun 10 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:04:26.193964 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:26.195408 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:26.197129 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1032205-1989-45fc-a4ae-84c3e55c6189 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:26.206273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef537e2a-3a86-488f-b6ba-f49e978fab61 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:26.209456 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 810/1597] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:26.211878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:26.212786 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:26.213071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:26.213379 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:26.215221 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:26.228271 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:26.230002 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:26.240707 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1598] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 13:04:29.376293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ecb4-ba3b-4b2e-9c10-7d680d1361f4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:29.376867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ecb4-ba3b-4b2e-9c10-7d680d1361f4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:29.376867 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2ecb4-ba3b-4b2e-9c10-7d680d1361f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:29.396278 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d7b2ecb4-ba3b-4b2e-9c10-7d680d1361f4 None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:29.397511 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d7b2ecb4-ba3b-4b2e-9c10-7d680d1361f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:29.404999 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 811/1599] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:29.417480 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:29.429201 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350303b-12f6-4c8e-85f6-1b17e73e5abb service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:29.434276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:29.434857 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:29.435141 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:29.435417 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:29.444217 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:29.445838 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:29.453883 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1600] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:04:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:04:37.829074 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04c8f-d037-4d79-9732-ff660e08a413 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:37.829588 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04c8f-d037-4d79-9732-ff660e08a413 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:37.829682 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b04c8f-d037-4d79-9732-ff660e08a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:37.847399 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-27b04c8f-d037-4d79-9732-ff660e08a413 None None] MFA Rules not processed for user `2fda4f42ba344b4f960ed39a006b887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:37.848520 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-27b04c8f-d037-4d79-9732-ff660e08a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:37.855702 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 812/1601] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Jun 10 13:04:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:37.868370 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:37.879872 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f1de-c8a6-4122-a3db-1203b15d7d1d service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:37.883513 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:37.884150 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:37.884435 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:37.884743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:37.892071 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:37.893587 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf33915-727b-4364-87e5-f047f478495d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:37.901519 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1602] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:38.804486 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62da6-f170-4247-ba9b-77503bedec88 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:38.804928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62da6-f170-4247-ba9b-77503bedec88 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:38.805401 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae62da6-f170-4247-ba9b-77503bedec88 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:38.806793 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 813/1603] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 13:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:38.818687 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a33e-bedf-491c-85b6-db67d010ccfd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:38.818995 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a33e-bedf-491c-85b6-db67d010ccfd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:38.819273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830a33e-bedf-491c-85b6-db67d010ccfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:38.851143 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3830a33e-bedf-491c-85b6-db67d010ccfd None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:38.852915 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3830a33e-bedf-491c-85b6-db67d010ccfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:38.864229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1604] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 13:04:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:38.879308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae62da6-f170-4247-ba9b-77503bedec88 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:38.905042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae62da6-f170-4247-ba9b-77503bedec88 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:38.905042 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:38.905734 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:38.906204 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:38.906482 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:38.917288 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:38.918899 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6249280c-cf37-4142-8c9d-bbd7945a740e service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:38.932739 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 814/1605] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:44.969104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8aef3-ef6b-458c-8bde-a55f28f804bb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:44.969713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8aef3-ef6b-458c-8bde-a55f28f804bb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:44.969713 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8aef3-ef6b-458c-8bde-a55f28f804bb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:44.971528 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1606] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 13:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:04:44.983299 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4a9b-0a80-4f50-992f-0df1d286224a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:44.983870 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4a9b-0a80-4f50-992f-0df1d286224a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:44.984303 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4a9b-0a80-4f50-992f-0df1d286224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:45.004717 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-25cb4a9b-0a80-4f50-992f-0df1d286224a None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:04:45.006223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-25cb4a9b-0a80-4f50-992f-0df1d286224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:04:45.015812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 815/1607] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:04:45.027979 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8aef3-ef6b-458c-8bde-a55f28f804bb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:04:45.042790 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8aef3-ef6b-458c-8bde-a55f28f804bb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:04:45.048104 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:04:45.048859 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:04:45.049170 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:04:45.049482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:04:45.059067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:04:45.060709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ddc7fb-abd2-4c59-af1b-a767ac94d27c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:04:45.071209 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1608] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:04:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:04:54.998756 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=70 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:04:55.066698 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:05:02.027631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:05:02.028103 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:05:02.028189 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:05:02.045631 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:05:02.046817 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:05:02.054626 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 816/1609] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:05:02.370257 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:05:02.370754 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:05:02.370849 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:05:02.389065 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] MFA Rules not processed for user `2fda4f42ba344b4f960ed39a006b887b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:05:02.390171 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:05:02.397229 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1610] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:05:02.409527 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:05:02.418711 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e84af-a9e2-417a-8f64-bf250e377616 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:05:02.422185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:05:02.422811 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:05:02.423092 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:05:02.423366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:05:02.430368 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:05:02.431805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f5590d-1e89-4847-bb0c-cf64203928c7 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:05:02.439576 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 817/1611] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:05:04.301747 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:05:04.311088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b79a28-9644-456b-8c3e-5c5035aa0172 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:05:04.315800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:05:04.315800 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:05:04.315994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:05:04.316259 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:05:04.325319 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:05:04.326740 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aa2b8-a3db-4842-912f-18d60360fa03 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:05:04.336052 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1612] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:05:12.436126 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=9 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:05:14.331797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:05:45.242669 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:05:45.243223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:05:45.243223 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:05:45.260574 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:05:45.261781 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:05:45.268438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 818/1613] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:05:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:05:55.255610 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:06:07.520095 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9231ecd-dc5a-435d-adee-4d0876e876db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:07.520582 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9231ecd-dc5a-435d-adee-4d0876e876db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:07.520702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9231ecd-dc5a-435d-adee-4d0876e876db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:07.538825 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a9231ecd-dc5a-435d-adee-4d0876e876db None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:07.540003 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a9231ecd-dc5a-435d-adee-4d0876e876db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:07.546978 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1614] 10.222.0.10 () {58 vars in 1009 bytes} [Fri Jun 10 13:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:06:07.587805 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:07.600509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1e602-972c-4f3f-aaa9-a634a2b036c3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:07.605573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:07.606222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:07.606509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:07.606787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:07.615656 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:07.617327 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fdd86-f3e2-432e-aec5-91db3408b654 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:07.625650 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 819/1615] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:06:11.080102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f27-50f7-434e-b392-5c1b26665fbb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:11.080556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f27-50f7-434e-b392-5c1b26665fbb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:11.080701 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c710f27-50f7-434e-b392-5c1b26665fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:11.099878 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c710f27-50f7-434e-b392-5c1b26665fbb None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:11.101094 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c710f27-50f7-434e-b392-5c1b26665fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:11.107767 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1616] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:06:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:06:16.487539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286973ba-7ec7-474c-b577-cc9f8545cfae None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:16.488085 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286973ba-7ec7-474c-b577-cc9f8545cfae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:16.488409 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286973ba-7ec7-474c-b577-cc9f8545cfae None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:16.489948 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 820/1617] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 13:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:06:16.503054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7058e-7d83-4b37-9fb1-c6166c922c20 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:16.503054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7058e-7d83-4b37-9fb1-c6166c922c20 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:16.503054 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7058e-7d83-4b37-9fb1-c6166c922c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:16.527197 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aec7058e-7d83-4b37-9fb1-c6166c922c20 None None] MFA Rules not processed for user `b91f8654801b49689bb5774097b59bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:16.528518 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aec7058e-7d83-4b37-9fb1-c6166c922c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:16.538972 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1618] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 13:06:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:06:16.567091 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286973ba-7ec7-474c-b577-cc9f8545cfae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:16.584535 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286973ba-7ec7-474c-b577-cc9f8545cfae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:16.590222 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:16.590813 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:16.591096 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:16.591366 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:16.602470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:16.604047 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:16.615575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 821/1619] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:06:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:06:26.524084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:06:26.610880 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=12 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:06:39.073450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e27b1-fac8-4361-be48-d7a26f7f348f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:39.073967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e27b1-fac8-4361-be48-d7a26f7f348f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:39.074058 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e27b1-fac8-4361-be48-d7a26f7f348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:39.091152 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-731e27b1-fac8-4361-be48-d7a26f7f348f None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:39.092326 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-731e27b1-fac8-4361-be48-d7a26f7f348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:39.099586 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1620] 10.222.0.10 () {58 vars in 967 bytes} [Fri Jun 10 13:06:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:06:39.111822 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:39.123390 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da07725-3d4f-420a-baf4-1ed344aee1b2 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:39.128235 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:39.129673 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:39.130061 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:39.130343 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:39.138243 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:39.139849 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d73685-e1b9-46db-81b4-0cabc596e93b service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:39.148351 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 822/1621] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:06:44.666179 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e53c-c654-4148-b849-0fc0c8830363 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:44.666670 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e53c-c654-4148-b849-0fc0c8830363 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:44.666774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3e53c-c654-4148-b849-0fc0c8830363 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:44.668454 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1622] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 13:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:06:44.674419 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b26e-397e-4c28-b421-6f53eefc3bdd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:44.674887 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b26e-397e-4c28-b421-6f53eefc3bdd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:44.674977 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193b26e-397e-4c28-b421-6f53eefc3bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:44.695746 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a193b26e-397e-4c28-b421-6f53eefc3bdd None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:44.697032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a193b26e-397e-4c28-b421-6f53eefc3bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:44.706020 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 823/1623] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:06:44.725688 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e53c-c654-4148-b849-0fc0c8830363 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:44.739455 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3e53c-c654-4148-b849-0fc0c8830363 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:44.744579 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:44.745245 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:44.745525 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:44.745796 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:44.755035 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:44.756729 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:44.766775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1624] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:06:47.736652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:47.737115 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:47.737308 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:47.755153 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] MFA Rules not processed for user `40b5c686224c477d907c4060565b8eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:06:47.756352 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:47.763467 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 824/1625] 10.222.0.10 () {58 vars in 967 bytes} [Fri Jun 10 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:06:47.779251 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:47.790949 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4fea6-9a46-4fed-91fd-2378add0db68 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:47.796004 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0042ad86624e4eb08844d9112381820e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:47.796678 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:47.796967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:47.797244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:47.805827 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:47.807514 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:47.815648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1626] 10.222.0.10 () {60 vars in 1384 bytes} [Fri Jun 10 13:06:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 10 13:06:48.821251 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:48.891197 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b90fa9-7561-46a6-b7b1-e60d16a0f49b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:48.896487 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:48.897420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:48.897705 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:48.897981 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] PATH_INFO: `/v3/users/a7ccace9d07f4bbb802b288510d78f73` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:48.899160 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7ccace9d07f4bbb802b288510d78f73)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:48.900430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: WARNING py.warnings [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:06:48.900430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: warnings.warn(msg) Jun 10 13:06:48.900430 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: Jun 10 13:06:48.901661 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:49.169342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7ccace9d07f4bbb802b288510d78f73'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.188321 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7ccace9d07f4bbb802b288510d78f73'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.198998 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7ccace9d07f4bbb802b288510d78f73'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.300471 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7ccace9d07f4bbb802b288510d78f73'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.301184 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7ccace9d07f4bbb802b288510d78f73'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.308194 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 825/1627] 10.222.0.10 () {58 vars in 1223 bytes} [Fri Jun 10 13:06:48 2022] DELETE /identity/v3/users/a7ccace9d07f4bbb802b288510d78f73 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:06:49.594046 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:49.609719 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668ca31-1650-4e59-b8aa-d737a113f78e service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:49.670402 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] PATH_INFO: `/v3/projects/0ab8b4d01c9947b591bf9299967a6c28` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab8b4d01c9947b591bf9299967a6c28)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: WARNING py.warnings [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: warnings.warn(msg) Jun 10 13:06:49.676495 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: Jun 10 13:06:49.677156 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:49.787920 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab8b4d01c9947b591bf9299967a6c28', 'request_id': 'req-f0a9c366-82f4-4390-88e0-2660aaeabfeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.803126 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab8b4d01c9947b591bf9299967a6c28', 'request_id': 'req-f0a9c366-82f4-4390-88e0-2660aaeabfeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.906088 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab8b4d01c9947b591bf9299967a6c28', 'request_id': 'req-f0a9c366-82f4-4390-88e0-2660aaeabfeb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.918748 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] The token cache is being invalidate because project 0ab8b4d01c9947b591bf9299967a6c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 10 13:06:49.919037 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.919684 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:49.921273 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1628] 10.222.0.10 () {58 vars in 1232 bytes} [Fri Jun 10 13:06:49 2022] DELETE /identity/v3/projects/0ab8b4d01c9947b591bf9299967a6c28 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:06:49.925198 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:49.926857 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:49.939967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e244314-2cb5-48bf-a06a-55721b750f70 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:49.991916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:06:50.000414 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:50.001330 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:50.002048 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:50.002334 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] PATH_INFO: `/v3/users/86df990df0e54e858b30d7338a56b931` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:50.003548 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86df990df0e54e858b30d7338a56b931)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:50.005513 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:50.349618 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86df990df0e54e858b30d7338a56b931'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.361539 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86df990df0e54e858b30d7338a56b931'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.370151 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86df990df0e54e858b30d7338a56b931'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.505824 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86df990df0e54e858b30d7338a56b931'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.506449 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4be520ba-5dfb-40de-9ce7-9c8f8638bb56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86df990df0e54e858b30d7338a56b931'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.513000 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 826/1629] 10.222.0.10 () {58 vars in 1223 bytes} [Fri Jun 10 13:06:49 2022] DELETE /identity/v3/users/86df990df0e54e858b30d7338a56b931 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:06:50.765014 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:06:50.766549 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:06:50.788804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9c366-82f4-4390-88e0-2660aaeabfeb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:06:50.843991 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:06:50.849885 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:06:50.850774 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:06:50.853743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:06:50.853743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] PATH_INFO: `/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:06:50.853743 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dee49723891429ba3cf1a3c8ce65ecc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:06:50.854606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:06:50.946252 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dee49723891429ba3cf1a3c8ce65ecc', 'request_id': 'req-3624ca5e-b1e9-4dfd-b669-045d6318050e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:50.952462 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dee49723891429ba3cf1a3c8ce65ecc', 'request_id': 'req-3624ca5e-b1e9-4dfd-b669-045d6318050e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:51.060286 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dee49723891429ba3cf1a3c8ce65ecc', 'request_id': 'req-3624ca5e-b1e9-4dfd-b669-045d6318050e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:51.071847 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] The token cache is being invalidate because project 7dee49723891429ba3cf1a3c8ce65ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 10 13:06:51.072132 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:51.072822 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:06:51.074394 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1630] 10.222.0.10 () {58 vars in 1232 bytes} [Fri Jun 10 13:06:50 2022] DELETE /identity/v3/projects/7dee49723891429ba3cf1a3c8ce65ecc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:07:00.509121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:07:01.069244 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:07:06.763272 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:07:06.763751 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:07:06.763838 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:07:06.790568 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:07:06.791752 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:07:06.858578 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 827/1631] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:07:16.856509 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=37 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:07:26.869396 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:07:26.870843 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:07:26.966364 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624ca5e-b1e9-4dfd-b669-045d6318050e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:07:26.970030 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:07:26.970668 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:07:26.970950 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:07:26.971231 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:07:26.973027 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:07:27.040062 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:07:27.041612 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:07:27.050804 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1632] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:07:37.046621 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=71 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:08:13.547561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:08:13.549094 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:08:13.639431 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d57db-1601-4109-9729-44cc4c86fc62 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:08:13.644432 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:08:13.645109 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:08:13.645391 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:08:13.645666 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:08:13.648105 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:08:13.659412 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:08:13.661014 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:08:13.670823 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 828/1633] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:08:23.666778 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=41 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:09:23.058911 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:23.060290 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:23.159728 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10826b10-fb7f-4787-9b8d-b7d9397740fc service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:23.165281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:23.165927 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:23.166243 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:23.166542 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:23.169102 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:23.179265 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:23.180888 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0d446-3ce2-43aa-abb4-a5682ccd2eed service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:23.190411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1634] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:25.883665 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:25.894928 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0f452-55b7-4a36-9531-45e56d24ffe4 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:25.900910 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:25.902452 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:25.902745 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:25.932242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:25.932242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:25.932242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:25.932242 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:25.933987 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 829/1635] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:28.140967 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:28.141447 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:28.141548 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:28.159589 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:09:28.160855 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:28.168080 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1636] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:09:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:09:28.482090 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:28.490347 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c155896-b7e1-4463-bc1d-0bae7cd99b03 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:28.493920 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:28.494559 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:28.495396 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:28.495672 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:28.497441 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:28.507209 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:28.508505 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:28.517219 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 830/1637] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:29.154882 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:29.156803 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:29.160580 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:29.169561 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ecbc2-df4f-4b51-95bf-d8dbe520821d service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:29.171986 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e7fe4-e5fd-469b-a038-5b2460342b7a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:29.173393 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:29.174032 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:29.174317 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:29.174591 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:29.176353 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:29.177083 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:29.177738 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:29.178026 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:29.178306 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:29.179994 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:29.190170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:29.191586 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:29.193023 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:29.194603 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:29.203285 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 831/1638] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 10 13:09:29.205021 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1639] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:39.197606 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=18 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:09:39.200597 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=55 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:09:44.776101 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:44.781185 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:44.791267 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd0aeb-0aea-4227-ac58-a7bbd503503d service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:44.797651 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06937-f180-4722-b22c-f6055657742b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:44.798289 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06937-f180-4722-b22c-f6055657742b service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:44.798575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06937-f180-4722-b22c-f6055657742b service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:44.798859 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d06937-f180-4722-b22c-f6055657742b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:44.800630 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-12d06937-f180-4722-b22c-f6055657742b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:44.812696 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d06937-f180-4722-b22c-f6055657742b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:44.816497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d06937-f180-4722-b22c-f6055657742b service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:44.824570 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 832/1640] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:45.192344 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:45.193746 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:45.205482 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad00319-1bfc-428f-ac2d-50c9a0bb2e76 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:45.209076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:45.211246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:45.211246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:45.211246 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:45.212133 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:45.221936 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:45.223404 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2caaac-a83f-4ce5-90d2-90d2790d3858 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:45.231157 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1641] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:48.792916 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06937-f180-4722-b22c-f6055657742b service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:09:48.804787 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d06937-f180-4722-b22c-f6055657742b service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:09:48.810506 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:09:48.811293 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:09:48.811708 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:09:48.811862 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:09:48.813712 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:09:48.826470 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:09:48.828050 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:09:48.838337 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 833/1642] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:09:55.227682 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:09:58.834121 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=12 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:11:23.067281 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:11:23.067805 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:11:23.067899 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:11:23.084820 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] MFA Rules not processed for user `afbd90eaa6344685b0cc079ca45df361`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:11:23.086012 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:11:23.092834 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1643] 10.222.0.10 () {58 vars in 957 bytes} [Fri Jun 10 13:11:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 10 13:11:23.415794 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:11:23.425967 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2a145-91ab-4c87-b0ff-925efdfff0c3 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:11:23.429575 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:11:23.430211 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:11:23.430497 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:11:23.430775 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:11:23.432558 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:11:23.442144 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:11:23.443562 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:11:23.451377 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 834/1644] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:11:27.493775 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:11:27.516369 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c43a5-29af-4ad6-bdfa-8f77401e401e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:11:27.523797 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b91f8654801b49689bb5774097b59bb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:11:27.524464 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:11:27.524779 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:11:27.525053 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:11:27.527051 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:11:27.542556 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:11:27.544380 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:11:27.560067 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1645] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:11:33.447892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:11:37.553527 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:13:17.750584 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:17.762033 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30a46c-8090-4a65-a6e4-3b301718e2e8 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:17.766871 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:17.767508 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:17.767791 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:17.768062 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:17.777502 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:17.779064 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12345407-8f66-45e5-9769-d2a2da722053 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:17.789830 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 835/1646] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:13:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:13:27.784812 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:13:30.110606 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:30.120016 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e543c-d514-4b95-9df6-2bda4d10f4b5 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:30.123652 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fda4f42ba344b4f960ed39a006b887b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:30.124315 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:30.124644 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:30.124947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:30.126702 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:13:30.209084 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:30.210450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce7a7e-bbbf-4981-afab-f97a45a94370 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:30.229345 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1647] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:13:33.650448 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aa825-7a3a-47f2-80b7-2f8abf102dcd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:33.650959 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aa825-7a3a-47f2-80b7-2f8abf102dcd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:33.651052 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0aa825-7a3a-47f2-80b7-2f8abf102dcd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:33.652637 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 836/1648] 10.222.0.10 () {54 vars in 921 bytes} [Fri Jun 10 13:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 10 13:13:33.661954 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:33.662576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:33.662576 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:33.719149 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] MFA Rules not processed for user `9ab4d412e09a4d68b47bc2d360380fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 10 13:13:33.720285 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:13:33.729780 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1649] 10.222.0.10 () {58 vars in 1018 bytes} [Fri Jun 10 13:13:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 10 13:13:33.740389 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aa825-7a3a-47f2-80b7-2f8abf102dcd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:33.754648 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0aa825-7a3a-47f2-80b7-2f8abf102dcd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:33.759093 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ab4d412e09a4d68b47bc2d360380fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '75b18d98ed7f4fcdb5001b74fbb99db2', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:33.759737 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:33.760007 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:33.760420 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:33.768573 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:33.770170 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:33.781881 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 837/1650] 10.222.0.10 () {60 vars in 1365 bytes} [Fri Jun 10 13:13:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 10 13:13:37.379216 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:37.381505 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:13:37.405418 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1940ef-6bfd-4323-93b4-3ea90cc691ef None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:37.411411 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:37.412276 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:37.412561 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:37.412877 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] PATH_INFO: `/v3/users/afbd90eaa6344685b0cc079ca45df361` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:37.414886 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbd90eaa6344685b0cc079ca45df361)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:37.417047 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:37.663924 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbd90eaa6344685b0cc079ca45df361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:37.675304 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbd90eaa6344685b0cc079ca45df361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:37.682085 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbd90eaa6344685b0cc079ca45df361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:37.741223 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbd90eaa6344685b0cc079ca45df361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:37.741840 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbd90eaa6344685b0cc079ca45df361'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:37.744039 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:13:37.748324 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1651] 10.222.0.10 () {58 vars in 1223 bytes} [Fri Jun 10 13:13:37 2022] DELETE /identity/v3/users/afbd90eaa6344685b0cc079ca45df361 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:13:38.000552 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:38.019233 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab776c4f-1bab-469e-afb8-b639cd784960 service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:38.071383 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:38.072268 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:38.072551 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:38.072851 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] PATH_INFO: `/v3/projects/fb1fb12769ea48e4ad7fe4a590095671` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:38.074088 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1fb12769ea48e4ad7fe4a590095671)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:38.075972 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:38.187714 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1fb12769ea48e4ad7fe4a590095671', 'request_id': 'req-779d2997-8328-4161-bd49-6a2e19f798ca'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.193652 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1fb12769ea48e4ad7fe4a590095671', 'request_id': 'req-779d2997-8328-4161-bd49-6a2e19f798ca'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.286404 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1fb12769ea48e4ad7fe4a590095671', 'request_id': 'req-779d2997-8328-4161-bd49-6a2e19f798ca'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.297858 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] The token cache is being invalidate because project fb1fb12769ea48e4ad7fe4a590095671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 10 13:13:38.298138 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.303856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.303856 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 838/1652] 10.222.0.10 () {58 vars in 1232 bytes} [Fri Jun 10 13:13:37 2022] DELETE /identity/v3/projects/fb1fb12769ea48e4ad7fe4a590095671 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:13:38.304262 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:38.306375 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:13:38.319045 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7148b0-23d7-4613-b69e-a6afff9c83c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:38.374757 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:38.375659 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:38.375947 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:38.376226 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] PATH_INFO: `/v3/users/b25be400236b4ed98c7d66cd58bc522b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:38.377450 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25be400236b4ed98c7d66cd58bc522b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:38.379372 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:38.573648 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25be400236b4ed98c7d66cd58bc522b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.585180 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25be400236b4ed98c7d66cd58bc522b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.592709 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25be400236b4ed98c7d66cd58bc522b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.634841 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25be400236b4ed98c7d66cd58bc522b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.635473 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-223c602d-d428-432b-b268-95f7fab28f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25be400236b4ed98c7d66cd58bc522b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:38.641769 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1653] 10.222.0.10 () {58 vars in 1223 bytes} [Fri Jun 10 13:13:38 2022] DELETE /identity/v3/users/b25be400236b4ed98c7d66cd58bc522b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:13:38.885499 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 10 13:13:38.889522 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 10 13:13:38.900438 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d2997-8328-4161-bd49-6a2e19f798ca admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 10 13:13:38.957657 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7bb6edd4f154eb88b778d90110b667e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cacd4613b1334c5abdaa9f563eb09cde', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 10 13:13:38.958608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 10 13:13:38.958892 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 10 13:13:38.959163 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] PATH_INFO: `/v3/projects/7ad9a030899b4b1183443aeb2238c37a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 10 13:13:38.960342 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad9a030899b4b1183443aeb2238c37a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 10 13:13:38.962932 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 10 13:13:38.984200 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:13:39.057844 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad9a030899b4b1183443aeb2238c37a', 'request_id': 'req-15454a69-22b0-43ef-94f6-9a15180f49bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:39.063907 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad9a030899b4b1183443aeb2238c37a', 'request_id': 'req-15454a69-22b0-43ef-94f6-9a15180f49bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:39.137841 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad9a030899b4b1183443aeb2238c37a', 'request_id': 'req-15454a69-22b0-43ef-94f6-9a15180f49bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:39.149628 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] The token cache is being invalidate because project 7ad9a030899b4b1183443aeb2238c37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 10 13:13:39.149975 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:39.150608 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-15454a69-22b0-43ef-94f6-9a15180f49bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 10 13:13:39.152180 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 839/1654] 10.222.0.10 () {58 vars in 1232 bytes} [Fri Jun 10 13:13:38 2022] DELETE /identity/v3/projects/7ad9a030899b4b1183443aeb2238c37a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 10 13:13:48.638076 dv-osbrick-master-4-iscsi devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 10 13:13:49.252247 dv-osbrick-master-4-iscsi devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}